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ABSTRAQT 

This report describes the conceptual framework of a 
study examining therj feasibility' of developirigr on a nationwide basis, 
a system of statistical indieatbrs of educational knowledge outputs, 
dissemination structures, and knowledge utilization settingfs and\ 
cutccmes, along withv their contextual indicators. Osing the notion of 
social indicators to measure educational, knowledge prcducticfn anjiv\ 
utilization, a model of a functional system of indicators consistik^g 
of fQur major components was developed: (1) production output \ 
indicators reflect the extent and- ways in which the educational . V 
knowledge -^productions community organizes and transforms knowledge in \ 
all its forms; (2) dissemination structure in.dicators display how 
resources are allocated across educational sectors and geographic 
2g:eas; (3) utilization indicators provide information regarding 
tregu^st and'^usage xates by geographic or educational sectors for 
types of institutional and individual consumers cf educational 
knowledge, products, and services; and (4) contextual indicators may 
be ^sed to predict or explain the pa€t erning of ether* type's cf 
indicators using demographic and geographic data. These indicators 
are examined in terms of major dimensions that nay prove useful in a 
conceptual mapping of the indicator domain^ and then in terms of 
implications of this dimensional mapping for the selection or 
development of indicators. (Author/CHM) 
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PREFACE 



One of the general objectives .of the Educational Dissemination Systems 
Support Program- (EDSSP) is to establish efficient means for analyzing, monitor- 
ing, and communicating the status, ''n^ecls, and acctDmpl ishments of dissemination 
perform^s. Previous EDSSP reports have described various aspects of .educa- 
tional dissemination including: synthesis of key studies (Emrick and Peterson, 
1978), analyses of dissemination and linking roles (Butler and Paisley, 1978; 

«a> * ■ . , 

. ■ . . - . ■ , ■ . ■ ' 

Hood and Gates, 1978; Gates, 1978), cost analyses of services (Paisley, Black- 
welU Emrick, Rittenhouse and Gooper, 1978), and descriptions of specific pro- 
grams and organizational arrangements (Adams, 1978;' Blackwell and Hood, 1978; ' 
Hood,, J978; Lotto and Clark, 1978; Paul, 1978; Rogers, 1978). 

Ln this and' two companion publications, we address the feasibility of de- . 
.veloping, on a nationwide basis, a system of statistic^il indicators of educa- 
tional knowledge production outputs, dissemrnation sti^uctures, and knowledge 
utilization settings and outcomes, along^with their contextual indicators. 
This repdrt describes the conceptual framework and briefly summarizes some 
empTrical work. ' ' - o 

EDSSP work on indicators may be traced to interest in examining statewide 
inter-organizational ^arrangements (Paul, 1978). If a. few states were selected 
for intensive case study, which states would be most representative? How could 
states be typed? Was there any objective basis for* typing states? Exploratory 
work (Hood and Blackwell , 1979) demonstrated ^that one could produce useful / ' 
typologies based on either (•a) s^tati^tical indicators of educational knowledge 

production an!^ dissemination capacity or (b) contextual, demographic, economic, 

^ "p . 

and educational data. State-level indicator data could be aggregated to produce 
{regional indicator data. In a companion EDSSP^ study of issues* concerning equity 



access to infonnation by various groups', Vaisley, Cirksena, and Butler (1979) 
a<komp1ished-the-more-di^ficultH^ea1rof-dts^ggr^^^ — 
Imqicator d-ata down to local-levels. ' > , ... 

As we prepared these two" exploratory .studies for publication, it became 
appaVenf that much of the cbnceptual framawork on which these studies were 
baseci^was "in our 'heads." ..Some kind of an. exfilicit description was needed. 
What l^egan ^s a brtef outline of our conceptual^approach Has become this small 
monograph that attempts to develop a comprehensive taxonomy. 

.Following an introduction and ov.erview of the framework, each of four in- 
rdicators\ areas (production outputs, dissemination structures, utilization, and. 
contexts), are discussed, first in terms of major dimensions* that may prove use- 
fuj in a conceptuaV mapping of the indicator domain, and then' in terms of im- 
plic|ationSi of this dimepsion^l mapping for the selection or development of in- 
dfcators. The four sections are uneven in length. The disciission of knowledge 
ba^e outputnndicators is long because several of the dimensions are relatively 
novpl,- but have significant .implications for analysis of the knowl edge" base. 
The \sectiorv on. dissemination structures and functions, is terse since it is pos- 
sibl'e to reference severa/ relevant publications. The section on knowledge 
utilization is quite long. 'In this section we summarize and critique several" 

\ \ ^ \ " - ' 

Itnesl of inquiry 'that^end to employ different conceptual izations of knowledge 
uilizatlon. After outl Ining major dimensional categories that encompass ,these 
Tines *pf Inquiry, we describe and critlqile available methodological approaches " 
to the ctevelopmeat of utll Izatlon^ Indicators and then discuss the current situ- 
ation. Tl^ s.ection on contextual indicators provides. a".bri§f descriptions of 
various types of contextual indicators and their possible i4ses. This is fol- 
lowed by a short section summarizing the exiil oratory data ^an^lyses reported by 
Hood and Blackwell (1979) and Paisley, Cirksena, and Butler (1979). A conclud- 

i • , *^ " 

ing sect|i.iin reviews the conceptual framework and commentsron Its potential uses. 



INTRODUCTION 



The Educational Di|serfii nation Systems Support Program (EDSSP) has three 
general objectives: 1 ) to estabUsh an efficient means for analyzing, moni- 
toring, and communicating the status, fifeeds, and accomplishments of educational 
•'dissemination performers; 2) to increase the quality of and access to knowledge 
pertaining to the educational dissemination and utilization (D&U) process; and 
3) to establish a "participatory" capacity for organising and conducting special 
studies contributing- to the improvement of educat,i0nal dissemination as a re- 
gional and nationwide .effort. - • " 

With respect to objective 1, EDSSP staff completed an analysis of signifi-^ 
cant recent ^current efforts to" define. the status, needs and acompl ishments 
of educatj<)nal dissemination performers and has published two reports, one fo- , 

jHfS i-ng^s pec i f i c a 1 1 y - o n puflfeses and methods employed by current NIE-sponsored 
> W . 

activities and the second describing results of recent studies and current de-' 
«^ . - -> . ■ . 

scriptions: .' . 

• Blackwell, L.R. and Hood, PTD. Program Intelligencer, Activities in 

Educational knowledge Utilization: Comparison bf Sensing, Feed- 
forward, MonitX)ring and Evaluation-Concepts in Five NIE-Sponsored 
' \: Programs , (Far West Laboratory. June 19/8), 

« Hood, P.D. Statewide Educational Dissemination Capacity: A RevievT 
of Recent Literature and Current Infor^mation / (Far West Labora- 
- . tory; August 1978), ^ 

\ Our arralysis indicated that there* are many on-going efforts to describe or 

evaluate various aspects of educational D&U. However, the great majority of 

these efforts tend to foCus on specific agencies (e.g.; State Education Agencies), 

functions (e.g., information retrieval and 'distribution) or programs, (e.g., the 

National Diffusion Network, or the R&D Utilization Program). We can discern 

# # '■ _ ' ■ 

the beginning of more comprehensive coverage as evidenced in the "base-line" 
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stu<ji^.of trie R«D Excharigl (see for example. An Overview of State Dissemination 
Acnviries71?"4D~ek^^ 

. ination Efforts Supporting/School Improvement" (sponsored by USOE and- conducted 
by the NETWORK of- Andover, MA). But there is nothing approaching^ truly com- 
prehensive (i.e., multi-agency, multi-function, mu.lti-program) , nationwide "^picture 

. of educational dissemination. 

A second chara^eri Stic of much of the existing information is that it is 
primarily "qualitative" (e.g., descriptions of programs, actoivities. persons). 
In only a few cases can we find "quantitatiy'd" information tiiat has been collect- 
ed \yith sufficient care that there is a'trystworthy basis for projecting to en- 
tire populations.* In an effort to deal with the lack of a nationwide picture 
and the paucity of qu^ntitativ&.data. EDSSP staff be.gan to bufld a quantitative 
data base for the 50 states (and DG) and^to conduct exploratory studies of how 
this daM base could be used to describe educationa-l D&U status. This report ' 
describes the conceptual framework that guides the ^development of the data base. 
Two related reports (Hood and BlackweTl. 1979; Paisley. Cirksena. and Butler.; - 
1979) present results of exploratory, data analyses. 



* These exceptions tend to be either dated or of limited scope. Brickell (n.d.) 
completed a survey of researgh. development, demonstration, dissemination and 
evaluation projects and personnel but it was confined to State Education Agen- 
' cies and conducted in. 1969-70. Emrick.. Peterson.-and Agarwala-Rog^s (1977) pro- 
- vide a comprehensive description- of t,he National Diffusion Network. 1974-1976. 
Clark and Guba (1977) and Lotto and Clark (1978) provide a' recent study of the • 
=role of schools, colleges, and departnTents of education (SCDFs) in KPU that 
premits projection to the majority of SCDEs. The NIE-sponsored American Registry 
of Research Organizations in Exiucation (Bureau of Social Science Research, in 
preparation) will provide very 1 imi.ted\informati-on on amount and percentage of 
funding and numbers of personnel engaged \x\ "dissemination" in more than 2 500 
orga.nizatiorTS , . ' 



CONCEPTUAL FRAMEWORK ^ND APPROACH 




The potfon of "social indicators" (Bauer, 1966; Sheldon and Moore, 1968; 
Grossi 1969; Van Ousen, 1974); plays an important role in the approach that we - 
have-'taken. Social indicators are measures of status or. of changes in status 
of aspects of society,* In the field of education there are several examp^les 
of the use of indicators, e.g., to assess educational outcomes (Cobern, et al . 

1973) , to assist in institutional accreditation (Gingras, 1975; Walters, 1977), 
to augment "accQuntabil fty" program assessment (Clemmer, et al., 1974; Grady, 

1974) , br to measure general educational status and trends (Ferris, 1969; ETSj 
1976). ; General lyV educational indicators have dealt with student enrosMment 
demography (e.g., agfe, race; sex", grade level, retention rates, abil ity'grouplng), 
with achievement leve^^s (e.g., degrees earned, test results) or with staff demo- 
-graphy, institutional characteristics • (e.g. , size, programs-j facilities) or ♦ 
fiscal data (e.g., ]evels\and sources pf funding, level s and ""types of expendi- 
tures). ATthougK relatively few of the commonly available .indicators have*- a 

direct bearing^ on educational knowledge production, dissemirrati an or utilization, 

^ ' ' ^ ■ ' . 

some of th^em (e.g., size* and t:ype of ^staff, number. and type of institution, 
level of funding) mjght. serve as "contextual " .variables that' would likely be- 
related to educational knowledge production, dissemination .or utilization. 

Underlying our thinking about the use of social indicators ttf measure 
educational knowledge, production and utilization has been a model of a func- 
tional system of indicators consisting of four major- components: . 



j 




* "A social indicator. ..may be defined to" be' iPIt at istic of direct normative 
interest which facilitates concise, comprehensive, and balanced judgments 
about the conditions of ntajor aspects of society." Toward a Social Report 
(DHEW,.GPO, 1969). ' ' ^ ^ 



1) indicators of educational knowledge production outputs ;* 

--^2^) 1 iT^i"cTt6rT"yr e^ducTti 0^^^ ~ 

^ . 3) indicators of educational knowledge utilization ; - A 

.■ • . \ ^- 

4) indicators of contextual factors that may be used to predict 
or explain the patterning of the other^types of indicators. 

Productio n output indicators are concerned with estimates of the -type, • 
quantity, quality or other characteristics of quaatifiable un^ts of educational 
knowledge (e.g., documents) as related to their orgin (e.g.", author of institu- 
' tion.location)r .ideally, these indicators should reflect the extenr.anS;v^ays^^ 
^in which the educational knowledge production comniunity organizes and transforms 
knowledge in all its forms. Currently available data pertain primarily to formal 
documentary or, formal oral forms or their^eriyati ves '(e.g. , abstracts, cftations, 
proceedings). " \ ' ' ^ ^ 

Dissemination structure indicators are concerned with the characteristics" 
or capacity of structural or functional components of th? educational dissemina- 
t ion system (e.g., number and type of information search services, number andV 
type of linking agents). In general these ihdicators should display how educa- 
tional dissemination. resources - funds, people, products, services, 'and techno- 
logy are-allocated across educational sectors and geographic "areas. 

Utilization indicators shouTd provide information regarding request and 
usage rates, adoptions, impact , benefits, etc., by geographic or educational 
sectors for types of institutional and individual consumers of educational know- 
ledge, products and services. Currently there are very few satisfactory utilizar 
tion indicators,, available 6n a nationwide basis^ that can be qsed to inform us 
regarding the various facets of knowledge utilization or its impacts. 



* Note that we have excluded concerns with how knowledge is created, that is, 
^wlth the structure ^and processes of kn^ledge production. 



4i ll 



■ . . ■ ■ ■ \ . ■ ^ ' ■ • ' 

Contextual indicators provide irifopjnation concerojng distributibn across. 
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geographic areas (ftf changing composition and trends of aggregative data that 
^"TeTfect the demographic, organizational, social , political, economic, , and edu- 
^- • cational environments for educational knov/l edge production, dissemination and 

util ization.i Contextual indicators can reflect conditions or forces ^that may 

• . ■ ^ . ^ • ■■ ■ • • < . • • . ■ . - 

serv-e to supply, support, constrain or otherwise influence the production, dis- 

' •• " .• \ . ' \ • ^ ' 

semination, dr consumption of educatrorial knowledge. . • 

Relationship among types of indicators . Because of the sometimes highly . 

local connections of production, dissemination, and utilization (e.g., within 

an immediate primary group or within one organization) , it should not be surpris- 

ing to find strong correlations between some types of production, dissemination 

and'u^^ization indicators,, especjally thd%e that may be based on counts of 

units^P entities." HowevW, there is also strong reason to suspect that con- 

; textual factors Ce.g., population density, per capita wealth) might constitute 

* common underlying factors that may account for much of the observed correlation 

between production and disselnination indicators or between dissemination and 

utilization indicators when aggregated by region or state. For example, one 

. might expect that more populqus states or regions would display higher counts of 

4 ■ 

public^ions, higher numbers of information search services, and higher numbers 
of organizational and individual requests for information searches than would 
less populous' states or regions. It is also^efeisily conceivable that relatively 
. wealthier states and regions could afford to fund more knowledge production (e.g. 
research studies, innovative practices), support more extensive and expensive 
dissemination services, and crfeatefeducational consumer environments with the 
organizational "slack" and- incentives fostering less parochial forms of knowledge 

consumption. Hence contextual indicators need to be considered when examining 

. • - ' ' ' • ' ' ^ 

aggregate data. 



Although' an extreme simplification, we, may conceive* of tbe four sets of 

; ' ; . ^ ^ ■ 

indicators as being related as deptcted in Fi.gure 1. * 

" . • • **. •♦ • '• ' 

The general conceptual franfework- depicted in Figure V provides a basis for 
' '■ , ' ■■ ■ • 

going beyond simple description, to an analysis of relationships among inciicators 

within sets, and between tni^jCators in different sets. In our exploratory anal- ' 

yses, we depended^ort a^iintited set of indicators that could be easily located or 

constructed from exi'sting sources. However, a more systematic alW-i^detai^ 

framework is required for identifying indicators, if only;,to reveal the.limita- * 

- ' -^^ .-- 

tions andliiases of the more accessible indicators or, hltfpefully, to point to 

* • » ... , 

significant gaps where special efforts may be required to develop a more compre- 
hensive set of indicators. 

In the following sections we first define Mme .terms and then we examine 

\ • ■ r 

in detail sets of dimensions that may prove useful in classifying or'-'^map'pjng"^^ 

Indicators relating to 1) the knowledge base, 2) the formal dissemination 

structure, 3) the knowledge utilization area, and 4) context variables. 

. • ' • ' ^w,. 

ThetConcept of Knowledge and Its Relation to indicators of Educational. Knowledge *^ 

One of the attractive aspects of the term "educational knowledge production 
and utilization" Is that it is suoh an all encompassing concept. But thi^-aUo 
poseHsevere probl^ems if we are .to select -or blil ld-1ndicfators of educational ' knowl 
edge production, dissemination, or utilization* jTo some degree we ru/i the risk 
of limiting our ideas to those that are faijiiliar or conventional and qjjt indica- 
tors to those that are conveniently accessible. Consequently, before describing 
the construction of dissemination or utilization indicators, we need to digre^s^ 
to outline some ways of conceptualizing the body of educational knowledge produc- 
tion. We begin by presenting some simple definitions and will then proceed to' 

f ■ ' • i 

examination of several analytic dimensions. 



* Portions of this section are developed more completely in Hood (December 1978) 
and Hood and Gates (1978). 



■ FIGURE 1. : 

A SIMPLE CAUSAL MOjJEL OF RELATIONSHIPS AMONG -.^fs" OF 
. EDUCATIONAL KNOWLEDGE INDICATORS 
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P^ta are (^oded symbol s| signs or numerical indicafeii^ or the urfprocessed 
'stimuli that are "raw" data./ Information is data that has been subjected to 
some form of processing ffi.g., receding, suinmarization, ' col lation) . Intelligence 
consists of information that has been communicated to others, usualT/^th an 

f .... » > ■ 

atcompanyirt^ interpretation or evaluation of meaning or pertinence. Technology 

. , • \ ' - • ■' " . 

transforms information and produces products, processes or programs that can 

still be' regarded as information-bearing. Knowledge (in its broad sense) re- 

fers to the total body of data, information, intell igence, and technology and 
^' ■ " . ' . ■ ♦ , ^ ' 

to their organizing structures and principles, (i.e., the sum*of all that iiS 

known), l^nowledqe production and utilization (KPU), as a field of study,, is • . 

cpncerned with an examination of the processes of knowledge production, dissem- / 

ination, and utilization, and the factors that account for the character and / 
t • : . • ' • : ■ / 

timing'of those processes, and with developing strategies and tactics that fpster 

* '''' 
appropriate, timely, and effective utilization. Knowledge transfer is s6n)etimes 

used as a completely synonomous term with knowledge utilization, but in other 
i^sesois confined to the communicat^n/dissemination/diffusion phases of the KPU 
process (thus excl uding. production ^and sometimes' the incorporation and adaptation 
phases of the utilization process). \' ' ^ 

Educational KPU overlaps with .information science and the field of com- 
munication studies , that have, • idi: turn drawn on a broad range of physical,, 
social, and behavioral sciences and*technology. Consequently there is no dearth 
of disciplinary orientati6ns for viewing educational • KPU, but there is a distinct 
possibility that vastly different perspectives may be taken by different investi- 
gators depending on their professional, di-scipl inary, or problem orientations. 
There is also a strong possibility that particular perspectives may tend to omit 
or ignore aspects of KPU that are not central to the perspective. 
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' . KNOML^''^^ ^'^SE DIMENSIONS r , 

Dimensional Analysis of the Ed^iSJ^^^ Known Base 

£pra|j||ical level, it is '^^lief that a truly -comprehensive approach^ 
LS »to examine the full r^"^^ the educational knowledge base mapped 

against several facets or dim^nsl^"^' " l^hese include; V * ( 

■ ^ ■• ' # ^^^^ ' ' 

• Subject Ma tter^^ Content . ' 



• Structure 

- Form \ 

- Level 'of formality 

- Formats 

^ Collections and system? 



r Organization of "Knowled^^ ^J^^^''^ 

- Tangible/intangibTe ch^C5^^ ' - 

- Independence/^interactlV'' . 

- Separable/inseperable i:'^^^^^*^^r ' j \ ^ ^ * h 



- Audience'^orientation 



• Pasis ; ^ . ^ 

- Disciplined inquiry , ■ 

- Sponsorship 



k' ,J1->*^'' ' ''' 



7 



S|Kih a mapping is desirable ^"^^ to gain some idea of what one proposes 
to include, or where emphasis will P^^ced. . / v 



Content 

Subject Matter Content l The ^^^"^^^Icance of this dimension is well knowp 
to librarians and information spe^^^^^^^s who ar^ concerned with classification, 
cataloguing, indexing, design of i^^^'^'^J^ion systems, etc. The scope of the 
information base, the way it fs o»^^^'^^^^^i%nd i/ndexed, and the way users approach 
it when searching for information ^^^^mptlnp to use it can haje profound in- 
fluence on the character and effe^^ information production, dissemination,' o>^ 
usage, as well as on the costs an^^ '^^^^^'f'lts t(iat may be associated with any type 
of organized information activity* ^^.^^Use significant portions of at least' , 

, , , ■ . , - • . j - 



the formal documentary knowledge 'bases in education are content, classified', it ^ 
is possible to examine, at least grossly, the distributional propertie/and 

effects of Subject matter content. *This can be done by cross classifying many 

^ \ . . . , . 

knowledge production indicators in terms of'their subject matter content. 

• ; . . ' . . - 

Structure ^. 

• ■ . ' 

Forms of knowledge . There are several very general forms fn which know- 
/ledge is presented on communicated. These include: oral forms , document forms , 
nondocument. forms and references (to other forms). 

Levels of formal i ty . E^th of these forms are encountered at various levels 
of formality ranging from highly formal to very informal. ^ 

Formats . In Figure 2 these last two dimensions have been crossed. Within 
each cell of Figure 2 are found various common examples of formats in which 
knowledge is stored or communicated. iV^neral, the less formal the level, 
the more difficult it is to obtain or to develop educational knowledge base 
Indicatflrs. Nearly all our easily obtainable indicators -are associatechwith the 
formal level. Research in Education (RIE) is perhaps one of the few national 
bases in education that provides some help in assessing the character and content 
of semi-formal documents. * ^ 

There are also major problems in identifying or developing indicsi-tors for 
oral forms of knowledge. Only a very small portion of the most formal oral 
forms (e.g., a professional meeting or a national conference) is documented 
and referenced in easily accessible formats (e.g., proceedings, meeting pro 

gram abstracts, convention programs). 

"•v ■ - 

. Studies of communication modes for technical information indicate that 
approximately 60 percent of the information used by individuals in their work 
is obtained in the interpersonal mode, either face-to-face or by telephone. 

1 i7 
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n' r CLASSIFICATION OF STRUCTURAL FORM BY LeVeL OF FORMAL IZA^QN / 



LEVEL 


ORAL FORte ' 

. ;. " : /, 


DOClMEMr FORMS ^ 


' / 


\ ' ^ REFERENCES ^-^ 
(to dxal forms, document 
forms, and^materikls) 




/n terna tional _ ^ 

meetings 
symposie 
eoi^erencew 
panels 


Reviews r r^rints, pro" 
ceedings, preprints , Jour- 
nal articles, reference 
works, anthologies and 
collections, hard-cover 
books, so ft^ver hooks e 
micro^forms 


Published^Materialst ' text^ 
2xx>ks, workbooks,, case 
studies, manuals , guides , 
tests, videotapes, films 
(slides, strijpfsTf^ movies) f 
audio (record^f ,^p^pes) , 
displays, equipuant, 
games, kits, computer' 
software 


Citation Services t 
meeting program abstracts 
abstract Journals i 
listing of manuscripts 

receivSk 
current awareness^' 
book reviews ^ 

Hfeview .Articlest J 
colleation 

\ synthesis ' ' ■ . 

Subject Biblipgraphgt 
unahnotat&d, 
annoiat'ed 
evaluated . • ' 

Library^ Ca*talogues S Indexes 




^'Seminars 
Special 

conferences 
Telephone 

conferences 


Final reportit, tttchnical ". 
* notes , technical jnemos , 

progress reports, tech- 
^ nical reports, proposals, 

speeches, unpublished 

pnpers » 


Draft, and test forms of sng 
of the above instructional 
Ruteritiis ■ 


Reference^ ^ ci ted £n Jqur^X 
articles /^books, reports, ^ 
theses' ' " • 

Cataio^ues, advertisements, 
and publisJier9\ materials 

librarians - 

Conference presentations 

Advertisements in journals 


INFORMAL 


Conversations 
Telephone ^calls 
Corresp§gience 
Casual meetings 
Unplanned enooun* 
ters 


Manuscripts, drafts, mctaos, 
correspondence, notes, 
o\itlines (document) 

■ ; 

c 


rreatmeht^ outiines (X^mJ) , 
scripts, sthry hoarder mock 
ups, -xendef[inga , flow 
xihartstf.^ prototypes,^ i 
sketciies,. designs ^ specific 
cations ° 


Journ^ contents s library 

book shelves 
Personal report team files 
Personal index files 
Conversations 
Correspondei^ 
Requested document distri" 

bution 

Vnrequested document diktri" 

bution t 
Symposia 
Local meetings 
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' Fq||^ percent. shows up In w^itter^fo^n, of which. 25 percent'is infonnal (e.g., • 
;. correspondence, circulars, forms, photo'grap.hs) and on]y 15. percent is format 
' (and therefore subject to bibliographic control). The Education Market Study,, • 
(Hood and Blackw6ir,\l976; Hood, Mick, dnd Katter, 1976)- suggests' that the pro- 
portfanal use, of oral and written and of formal and informal information does 
vary^with 1;ype of educatiprial audience (e.g'., instructional staff, admini^tra- 

* , - ' • , 

^tors,.(3oveniaDCe ^oups), but that most of these differences are not very l,arge. * 
The implication is. that educational knowledge indicators .that -are based oh 
'Items that are under bibliographic control, and this includes virtually all the V 
measures that are commonly available, can, at best, rei^lec^ only 10 to 15 per- .. ' 
cent of the technical information that may be used in .educational work. The 
actual amount that is indexed and easily accessible is probably not much more 
than one or two percent. ,^-»1ost of what we ^ow '.about, the educational' knowledge 
base tends to be highJy biased on these^tvif dimensions of form and formality . ' 
For the present, there are few alternatives to working with available document- 
oriented systems (|.gs, ERIC, Citation Indexes, Books Jn Printi product or program 
catalogues); however, wIb must remain aware of -this' severe form/ formality bias. 
The "small scale studies complripg oral^and written or formal a nd^i-rvformal com- 
munication content leave, us with scant; hope that the conclusions we may draw* 
based on fomaT documentary sources, ^wi 1-1 be even broadly" gen#al izable to oral 

. , ■ ■ ' ■ ■ 4 ' ' ' ^ 

forins or less foriiwl document fdyms. ' .1 , . 



, . Coll act i^ ^pd'isystems . In Figure '2 the six upper right\hand cells have 
been heavily outlined. These cells tend to represent the tangit^le holdings of 
various organized libraries and information services. - KnowledgAroducti(fh data 
pertaining to the quality, character, and distribution of knowjl^dge appearing 
in these formats are generally much easier to acquire or estimate. j 
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Most "local" knowledge bases also incTude the infonnal\categon"es of the 
tangible forms.' Because these l*ocal bases are numerous apd diverse in thjeir* 
character we tend to have relatively little useful information concerning them 
• except in special cases, e.g. , Tibraries, media centers, or educational data 
systems. Even in these special cases most of the available data concerns the 
way these collections are organized, staffed, and funded. Other than for gross 
data on size and type of library holdings, there is virtually no data on infor- 
mal catQg9ries of information. 

Organiz ation . . . - 

: . . . ; Y. . ; • ■ - 

In thevprevious section we "focused on how knowledge terids>tG be structured 

by^form, formality, format, and in terms of collections, services and systems. 

In a strict sense,* data, information or Knowledge is. contained or conveyed with- 

2" these formats. After we identify and obta'in or gain access to the format 

"ite|^, we stA^must locate the data or^nformation wejnay be seeking. -Typically 

several sources and usually more than drte. type of source is used.- Libraries, * 

media centers, and information systems all striyg to organize r^heir- holdings 

to facilitate efficient storage and retrieval. However, in this section we are 

concerned with, how the knowledge .itself is organized 6r "packaged" for use, not 

with how th§^fofmats are organized for storage or retrieval. ^ ' 

At a molar-level there seem to be three or four somewhat interrelated 

dimensions al^ong which we can grossly sort or classify knowledge in terms of V 

'its organization.* These are: * - ' 

• Degree of tangfbility - intangibility 
■ • * Degree: of independence - interactivity 

Separability - inseparability / . k 

• Audience orientation : « ^ / 



* There are many other conceptions of the organization of knowledge that relate 
to epistemology, the sociology of knowledge, rhetoric and logic, perception 
and learning, effective communication, propaganda and persuasion*, etc. These 
may or may not 'be related -to specific examples of the organized types of knowl- 
edge (i.e., products, -programs, practices) that are discussed in this section. 
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Guba (.1968) outlined foW sets of assumptions which need tq be determined: 
in-tecms of dissemination pdl.icy/ One of thes^e wa^ "Assumptions c-oncerning the 
substance pf tha product, program, or knowledge to be'disseminated.'" Ho.od 
.1976) examined various facets of this assumption in a paper titled "Analytic 
Summary of Considerations Affecting Dissemination." Hood noted that the content 
'of educationa.1^ knowledge ileeded to be conceptualized in ternte of several dimen- 
sions.. One of the '^ost powerful of these , is a complex dimensVon indexing the 
^^degree oftangibil iti,^ independence, and separability of the'"unit" to be dis- 
'-seminated: ) He noted khat leducational products (e.g., textbooks/educational 

ilms), are highly tan|iBl^nd may be isolated and chosen for use as relatively 
^independent entities.4 On the other hand knowl edge^^er se (e.g., thought, ideas, 
:tacit knowledge^t is ir|angible, and usually highly interactive with other know- 
4-e£lae,-i.e..,. facts andtideas usually find J:heir meaning and utility only in*the 
context of, other knowledge. ^ It is sometimes hapd to separate a piece of krjow- 
ledge from its context. 1 Educational programs and practices tend to occupy an 
intermediate poXition between highly tangible produbjts- and intangible ideas. 
Some programs. and\ practices are well defined ^nd documented in terms of text- 
BookSii teachers' gOides, program management aids, and other instructional" ma-, 
terials or documentation. However, virtually all programs hav£ some inherent- 
ly intangible elements; and some programs and practices (^.g., team teaching, 
peer tutoring) are primarily intangible. When their essential characterjis 
not easily communicated, they may be highly susceptible to mis-interpretation; 
attempts-at replication may vary widely. Dissemination and utilization of the 
lat^ter is qualitatively different from dissemination or utilization of a teict- 
book. ' ' . I 

The ctiaracteristics of independence and interaction are similarly impor- 
tant. It is rare that a particular program will work everywhere, A program 



that could be highly successful in one context may have an extremely unfa vdr- 
able prognosis in another. To. I he extent that programs are highly , interactive.' 
- .they pose special problems for evaluation, for distributor arid consumer choice 
among alternatives, and for achieving effective implementation. 

Audience-o rientation . This facet of knowledge organization tepds to become 
increasingly relevant when, knowledge is more highly organized (e.g-., products, 
programs, ^'M/1 edge syntheses, information systems). And to a significant 
extent it is a derivativeiof the interactive character of these more organized 
forms of kno\*ledge. If these organized forms do not work equally well every- 
where, *this implies that there are .many- choices in terms of how knowledge is, 
organized" and communicated (e.g., regarding types of users; settings a'nd condi- 
tions^degree 6f effart the user-must exert to acquire, understand, evaluate, 
use, etc.). For instance, an i nfjrmation analysis product may be research- 
oriented or prjact ice-oriented; if practice-oriented it may be designed especiaVrSr 
for administrators, for content specialists, for teachers or" for the. lay publicci 
Depe^nding on how the knowledge is organized the "difficulty" or 'jcost" (to ob- 
tain, understand, evaluate, apply, etc.) may be relatively high or Ibw; this 
level rtiay TTiatch or mismatch the users', capacity or difficulty /cost threshold or 
ceiling. (Items. can be too hard; they can also be too ^y.)* 



Basis ■'' 

- R&D basis . Educational knowledge can be classified by contett, structure, 
and organization.- Another dimension that tends to be especially important to 
the educational R&D community and that may or may not be of importance td the 

* From the user's point of view there is a complementary concept of user signi- 
ficance , i.e., how these more organized fdrms of knowledge are perceived and 
evaluated by users. Rogers (1962), , Havel ock (1969), Rogers & Shoemaker (1971), 
Zaltman, Duncan, & Holbek (1973), Glaser (1973), Sikorski & Hutchins (1974), 
offer a variety of dimensions that relate the attributes of innovations to 
user significance. . . 
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educational practice comrnunity relates to the extent that knowledge, in its 
' various organized forms and formats, is based on disciplined inquiry. Some . pro- 
duct s^ programs, ^n^kno^ are the results of a high degree of discipl ined 
inquiry (i.le., the outcomes of rigorous research, development or evaluatxion 
processes); o^efs may be only remotely based on or poorly verified by disci- 
plined inquiry. The vast mass of educational products, practices, and less 
tangible forms of knowledge tends to have only remote association with any form 
of disciplined inquiry, despite in many cases* haying survived the test of time.' 

Cross-classification of organization and R&D ^basis . Figure 3 presents a 
three dimensional depiction. For the moment we shal 1 .confine our attention to 
the front face where we have conjoined the two dimensions of organization and 
of R&D bas«is , and have arbitrarily mapped out nine regions.* Beginning atxthe 
tog left we find the tangible products of R&D.- Progressing to the right, the 
R&D products shade into R&D based or validated programs. As these programs be- 
come increasingly intangible, they shade into "synthesized" (e.g. ^practice- 
oriented) research based knowledge (e.g., regarding practice and theory) and 
then finally into highly intangible, abstract, and. generalized or. fragmented 
R&D-based knowledge. ; 

As we proceed across the next row we encounter the same forms of organi-? 
zation; however the "validity" of knowledge at this second level is based far 
less on the R&D (discipl ined inquiry) process and far more on pragmatism. 
Successful product^ are usual ly those that are marketable, profitable, and 
able to win^and maintain consumer acceptance. Promising practices may be pijjre- 
ly practioner innovations that have neither an R&D Ibasis^ nor evaluation data 
to prove their claims, but that are judged to be wprthy or promising by compeffeXt 
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* This- section appeared in Hood (1976) and has been reprinted in DAG (1977) and 
Cranda.ll (1977)-. ' - 
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. FIGURE 3 , • 

A CONCEPTUAL MAPPING OF EDUCATIONAL PRODUCTS, PROGRAMS, PRACTICES, AND KNOWLEDGE 
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I^ 
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—.A — /- 
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/ ■ ■ ' ■ 
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' ^^-^ 
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GENERAL / • 
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' educators. Consensual know1?dJe is not produced by" di^cipl ined inquiry oroschb- 
larship, but' it is accepted ^ valid and reliable by "the consensus of those who 
-must rely on It. • < 

. • •^^InV.the last row we encounter a ^vast grey area gf relatively u'nvafidated V 
products, pr^actices. and knowledge. Their "validity" depends primarily on the 
preYalence.of their use ^ on their utility for specific users. Credibility / 
and utility are the operating criteria .that separate thp usef^il from the .useless; 

, . Sponsorship. The third dimension in Figure 3 refers to the source of spon/; 
sorship or funding that produced the knowle,dge^r that supports the disseminat/on 
of various forms of knowledge. From a Federal (or a State) government" perspective 
the question of the degree of government funding (all to none) may be a non-/ 
trivial issue. For instance, only federally supported products are de^cribid 
in -the two-volume Catalogue of NIE Educational Products , only federally siiport- : 
ed (and JDRP-approv6d) programs appear in Educational Programs' That Work / Only 
these federally sponsored programs are eligible for dissemination through the ' 
National -Diffusion Network. * Nonfederally funded infQmat ion does appear in 
Research in Education , but federally funded R&D project reports arg far more 
likely to be accessed by RIE than reports of nonfederally funded projects..* ' 
Federal funding is thus something more'tharr simply an issue of whether finan- ' 
Cial resources are provided to produce knowledge, , it also may affect the method 
and extent to which the knowledge may be documented, referenced, and dissemi- 
nated. Although less, pervasive, state education agency sponsorship sometimes 
operatesfn similar ways in the selective filtering of knowledge that the SEA 
communicates (Elwell-and Dwyer, 1979). 

Sponsorship of knowledge by other types of agencies- (e.g., nonprofit foun- 
dations, commercial firms) also may significantly affect visibility, access, and 
dissemination of more organized forms of, knowledge (e.g., foundation sponsored 
programs, commercially promoted products or iservices). 



In general, sponsorship interacts vfth.degree of knowledge orgaoizatioh.- 
Investments are required to bring knowledge to more organized foniiSv(e.g.,, pro-, 
ducts or/transportable programs and practices). These inves:tments are just1- . 
fied if these forms of knowledge are sufficiently utilized. Hence production : 
of more organized forms of knowledge tehds.to become linked with organized forms 
.of dissemination. Beeause .of proprietary interests, th,is sponsorship tends to 
be highly segmented, e.t|., between government, foundations, and commercial sec- 
tors, or among various government or commercial subserttfri^.* : ■ " . 



Implications for Development of Education Knowledge- Bas^ Indicators . 

In the previous section we have described four major dimensions (and sev- 
eral subdimensions) that can be used to map the educational knowledge base. 
These were: content', structure, organization, and'b^sis. These dimensions 
can be^ used to define the scope and nature of our knowledge indiqators and to 
alert -us to biases that may exist. 

Content . We noted that knowledge' is often classified by^Slibject matter 
content, and that it is therefore possible to examine at least those parts of 
the bas^that have been classified or indexed in terms of the estimated absolute 
or relative amount and kind of knowledge in various major content ar^as.**\ 
There are a -number of technical problems that make this kind of effort quite 



* Less, organized forms of knowledge (e.g., results of fundamental research, 
applied research or evaluation studies) tend to be segmented more powerful- 
ly by content (as reflected .by disciplinary orientation, by>sub-field of 
the educational or related field, or by problem area) than by tj/pe of spon- 
sorship (e.gt, governmental _vs. non-governmentaM> 

* Hood (1973) in' a exploratory- investigation of tfl^fcjbject' matter content 
of ihe domain of R&D training resources, demonst^pFed 'that content area 
counts for RIE, book titles,, and instructional materials, were correlated 

(r = .6) and that rough estimates of quantities could be made for one fo*^, • 
given the" content estimates for ot'^er forms. Paisley, Cirksena, and Butler 
(1979) demonstrate how subject matter content can be cross classified by 
special audience orientation to investigate information equity issues. 



:^ficult, e.g. , use of different types of .indexing systems, 'ifiabl jty to 



estab- 



^ lish^corresppndencer among'' terms in different indexing systems^ 'absence of index 
: terms that deal with areas, of -specific interest, costs .of*-estimat;ing content 



coverage for nonclassified or inappropriatedly classified collections; The 
curr,ent EDSSP indicator^ analyses have only briefly explored subject matter 
content due to these^ technical difficulties, later analyses should examine how 
well these findings, based on the entire subject content area, fit smaller sub- 
ject matter partitions of various knowledge collections. ^ 

Structure . We noted that the formats in which knowledge appears car/ vary 
by form (oral , document, nondocument, references) and by level of formality 
(formal, semi-formal, informal)., (See Figure 2.) The structure af the knowledge 
base is significantly related to our ability to develop .satisfactory indicators. 
Generally, only the formal Tevel of .knowledge, comes under ade^ate b->bilographic 
control and is therefore available for analysis even if special efforts are made 
to conduct the analysiSd* Consequently we know very little about most oral ^forms 
or informal levels of knowledge. We know only slightly more about semi-formal 
levels of/documentary forms, largely through. the fact that RIE accesses a modest 

(but unknown and probably relatively small) portion of this type of documenta- 

( ' ■ ^ 

tion. Formal levels of nondocument materials (e.g;, textbooks, audio-visual 



aids) are accessible, but usually are less conveniently or adequately referenced 
than document forms. In ger(kral , the major portion of our information about 
the educational knowledge base is derived from colTiections of formal level docu- 
ments. or instructional materials that are referenced by national information 
reference systems (e.g.; RIE, CUE, NICEM,* Education Index , Reader's Guide To 
PerlodicaJ Literature , Psychological Abstracts . Dissertation Abstracts, Current 
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\ : * National Information Center for Educational Media, University of Sotithern , 
California-. 
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Contents . Books in Print , etc.). This fact' may mean that there are severe 

. . _ ^ _ ^ . ^ _^ 

biases in our concieptipn of the total knowledge base, since these well refer- 
enced, forraal'sources constitute no more than a few percent of the total volume 
of educational knowledge. 

Organization. Basis and Sponsorship . Figure 3 reminds us that there are 
additional dimensions that may severely attenuate or bias ©ur concept of t-he edu- 
cational knowledge base. First, we tend to treat more highly organized forms of |^ 
» knowledge (e.g., products or ^grams) in ways that are conceptually and practi- 

^ cally very differa^it from less organized 'forms. (This point will be discussed 
further when we corTsider knowledge utilization indicators.) Second, we tend fo* 
place miich greater emphasis on knowledge that has a more'substantial R«D basis 
(usually by assuming that R«D-basedJ(npwl edge is more trustworthy). Finally, 
sponsorship may' affect the importaifee that ^f^'attached to, or the availability 
^ of data concerning th'e more organized forms of knowledge. Less organized forms 
of knowledge tend to be- associated with the commurvities (e.g., scholarly disci- 
plines, sub-fields of the. education profession, or groups of practioners dealing 
with similar problems) that tend to produce _and use those forms of knoiftfledgei 
.Because more organized forms require additional investments to achieve higher - 
levels of organization, sponsorship may become an important factor that influen- 
ces not or^ly the production of knowledge, but its documentation, accession by 
abstracting and indexing systems, and its promotion and distribution to consumers* 
I Organization, basis, sponsorship, and sObject%atter content may all affect 

the composition of various collections or the scope of reference sources upon 
wfrfch^ur indicators are based.' Our current indicators tend to' be focused 
primarily on subject matteri.oritent ^f^^ CtirricuTum and Instruction (including 
teaching and learning) at elementary and secondary levels, on governmentaTly 
sponsored R4D based knowledg^br commercially produced products, and pertains 
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almost exclusively ?;o formal levels of documents or materials. If this is true. 



^aft portion or the tot^ education knowledge base ^are we covering? > How/fiar 
canlte generalize? 
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• DISSEMINATION STRUCTURE DIMENSIONS V^. • 

Dimensional AnalyslStof Educational Dissemination Structures and Functions 
• EdueationfKl knowledge. In 1t% various formats. Is communicated ^through | 

large variety of Inedla' and channels. The soirees and channels that/educational 

1 nformat.1 on" user s^ employ will be discussed In a subsequent sectfon on utillza-. 
; . tlon. 'In this sect1on;we are concerned with' the more formal structures and 

• .arrangements that have been deliberately created to facilitate communication 

or to provide access to knowledge. Fortunately, there are several^^rtlnent . 

studies that have dealt' directly with frameworks for analysis of this area. 

, "1 ■ * ■ 

These studies suggest that 'there may be as many as ten dimensions that need to 

be considered in mapping the character of educational dissemination structures 

and functions. • ' " ' - 

' Butler and Paisley (1375) have provided a genera]- taxonomy for mapping 

• , educational dissemination structures in terms of six dimensions: ' 

1. Level (of sponsor'Ship of services) % .-^ 

• National- P . - 

• Regional 

• State _ ' " ' . 

• Local 

2. Base (institutional base or setting) 

• Government, Centralized 

^ • Government, Decentralized 

• Professional Association ' . 
, • University 

\ • Private, Non profit * - 

\ • Private, For profit 

• Consortium 



3. Services Provided* 
• Information 

- Retri-eval Services * 

- Publication Services 



~ ■ 

* Butler and Paisley (1975) identify 24 specific services within the four 
major service^ategories listed here.- 
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• Instructional Materials (media services) . -v r v / 

• Hum^n Services .{guidance, referral, consulting, technical f i - 

a s s i stance^e t c . ) ^ ^ :_^___±__ f—-' 

•Continuing Education ; j 



r 

/ 



4. Focus of Services ■ 

• General - ' ? // 

• Subject Specific ^A '" ' 

• Product Specific ^ ' ^^IS ' M 

• Audience Specific \ -/ A 

5. Client Interface ^ : ) W*^ 
•'Print- / ^"'tf'. 

• Media \ • 



• Human T . ' 

■ r • .... 

6. Source of Initiative (for undertaking services). • 
. • Client ^demand services) - 
If Staff" (scheduled services) ^ 

^ The Butler and Pa isjey taxonomy was used to classify more than forty link- 

/ age models. Then Katter and Hull (1976) employed these dimensions in an intensive^^ 

field survey of 53 information service sites throughout the ^United States. To 

guide sampling, the fourth and fifth Butler-ffeisley dimensions (Focus of Service, 

Client Interface) were combined to form a new dimension: 

• Main Orientation ' ^ 

• Audiertce-(cl ient-)oriented ' • 

• Service-oriented 

• Collection-oriented • . 

• Product-oriented 



• Product-or|( 
i1p(4)rientatio| c 



Malprlorientatioa and Service area (national state, regional, or local) 
were chosen as the two primary dimensioris to select representative services. 
(The ictual sample/-tff 53 sites displayed significant variation along all six 
of the Butler-Paisley dimensions.)- Because the Katter and Hull survey focused^* 
on educational information services defined as consisting of some form of educa- 
tion information collection(s) with a conduit or means of outside access (i.e., 
b^ond the organization lousing the service), typeS'Of educational dissemination 
structures where a collection of some sort is not a significant feature (e.g., 
teacher centers, school study councils, inservice training consortia) were 



•{f excluded. Despite this "collection bias," the Katter and Hull study results 

-provide a corrdbbrat1\re denu^nstration-gf^the-gener^UA^a^ue-of^^ — - 
taxonorny. The following conclusions from the Katter ^d Huir survey are*1llus- 
trative: 

. The activities represented by these information service 
/ .J. sites did not display a -few well standardized work-role 
^ patterns, but rather showed considerable diversity. The 

kinds of materials, artifacts, functions, and activities 
jconsider;ed by these sites to be educational resources were 
^"irtumefQus.- Many sitei^ a large proportion of all 

^ service activities, but the activity mixes were. unique. ^ 

There are important and consistenrt deferences among collec- - 
tions that serve different functions, and neither leadership • ' 
nor planning and policy factors can be safely generalized 
across different^ types. . 

There are clearly distinguishabte operating service orienta- 
tions among sites; these have important ramifications for 
maintaining the overall basis for satisfying educational 
information user needs...' 

'The pattern of service request channels is different for 
print, nonprint, and- machine-readable collections. 

Distinctiohs can be drawn between the different goal- 
oriented viewpoints that provide the initial iriipetus to 
the development of a collection, i.e., collection-oriented, 
audience-oriented, high-level decision^ or program. 

Four other types of measures are dealt with either directly or indirectly , 

in Butler and Paisley (1975; 1978), Katter add Hull (1976), and Paisley, Black- . 

well, EmrickV Rittenhouse, and Cooper (1978). These are: 

' - . ■ ** ' ' . 

7. Inputs 

• Funding , ' 
Staffing 

• Knowledge resources 

• Technology resources 

• Other resources (e.g., in-kind contributions, special relationships 
with sponsors or clients) 

8. Structures- (missions, structures, functions, SOPs, etc.) 

• Organizational arrangemeqts 

• Information processlng/service^structures 

• Communication structures 

• Other structures « 

■ . it ' ■ " ■ 
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9. Outputs (to clients) 

• Direct outputs 
__t_[ncLtce ct out puts-(-e^gi^-C-1-1 e nt-outcomes ) 
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•10. Contexts ■ . \ /-^ . ' . 

• Intraorganizational 

• Interorganizational • * 
•Environmental (technical, social, political, economic, . - 

cultural, historical); — . . 

■ '■.,»■■. 

For our present analytical purposes, these ten dimensions may be sufficient 
to categorize educational dissemination' services. However, ther'e is already a 
substantial body of descriptive literature that points -toward need for greater 
refinement of the human category of the CI lent Interface dimension (# 5 above), 
particularly In terms of the roles and functions of educational linking agents 
(Haveiock, 1968; Sieber, Louis, and Metzger, 1972; Piele, 1975 ; 'crandall , 1977; 
•Culbertson, 1977; Lieberman, 1977.; Moore, 1977; Butler and Paisley, 1978; Hood • 
and Gates, 1978; Emrick- and Peterson, 1978;. Louis and Sieber, 1979). After ^ 
reviewing these references, Xates (1978) identified and discussed f2 structural 
factors that appear to influence linking agent functions. These are: 

• the linking agent's position within ajiroject or program; 

• the modal or generic role performed by the linking agent; 

• the stage of the dissemination process in which the linking 
agent and'clients are engaged; 

• the 1 ocation of the linking agent in relatidfn to the client 
- system (external versus internal); 

• the time (full-time versus part-time) the linking agent can 
devote to theJjob (also the time the linking agent can afford 
to spend with each client); 

• the experience (training and relevant work experience) of the\ 
1 inking agent; * ■ 

• the maturity of the dissemination project ; 

• the, maturity of the client ;^ ' \ . 

• the scope> character, and maturity of the resource/support 

33 .... ■ ■ ^ 
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» the context within which the linking process Qccur<;r 

• the roles and functions of significant others engaged in dissemina- * 
tion or educational improvemient; and 

^ ., : . , : : 1^ ^ : , ■ : , , . ^ — 

• the type and degree of differentiation among content domains 

^ (e.g.^ technical- skill s^,- cognitive personal attributes). ' 

We doubt that as many as 12 structural factors may be needed to establish,' ' 
■ ' . ■ ■ ■ ■ . ^ ^- • • 

;at ;a practical level, the most important differences in linking agent^^-functions; 

. * * ' . .^-'^ ■ 

however, we do expect that further differentiation in the CI ient^ Interface - 

Dimension (#5 abdve| will prove useful^ ' ' ^ - - 

Impiltations for Development of Educational Dissemination Structural Indicators . 

The federal government has collected and reported statistics on public 
libraries and academic libraries for nearly 110 years, and for school librar- 
ies and media centers for nearly half th^^ime. From the mid 1960's to the 
mid 1970's, the National Center for Educational Statistics (N(^) conducted 
separate surveys for elementary and secondary school libraries, college and 
university 1 ibraries,^ and public libraries. The Library General Information 
Survey (LIBGIS) was initiated in FJf 1974. The series of LIBGIS surveys have 
included publ ic libraries, public school libraries/media centers, ^college and 
university libraries, fede/al, state, and speciallibraries in federal and . 
state governments and in commerce and industry. Data in these surveys included 
information on print and nonprtnt materials, expenditures, staffing, physical 
facilities, service activities, and hours of service. 

Although the NCES data on libraries and media centers is extensive and is 
available for sme and local levels (i.e., library systems in institutrons of 
higher education; V^blic libraries serving communities of 25,000 or more) these 
types of collections, represent only part of the diverse set of educational 
Information centers and services^ that exists**^ Butler and»Paisley (1975), the 
.NIE Databook (1976) and Katter and Hull (1976) provide sources of information 
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concerning the types, general numbers, coll ect i ons^ fotict tons,' cl ients, pro-^ 
ducts and services^ staffing and organization of 'a variky of nonlibra r v In for- 
mation centers and services, tj^alitatively, we know a great deal about the 
general types of educational information centers and sepVJces. But current, 
comprehensive, nationwide surve>^data does not exist for;nonlibrary collections 



or systems.- Consequently we knowlmost about the more traditional, collection- 
oriented, archival systems and least about the "newer, cl ient-oriented centers • 
and services.* /, -^v ir ■ 




4^ 



5, . ' 



a- 



ERIC 



^ Some l ibraries have moved significantly toward, a greater cl ient and service 
-orientation, but our data systems tend to be blind fe«rT|roviding any k^nd ofl 
information that could be use^l to indicate these trends. 
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KNOWLEDGE UTILIZATION DIMENSIONS 



Dimensional Analysis of the Educational Knowledge Utilization Area 

Analysis of the educational knowledge utilization area tends to be diffi- 
cult for two reasons. First, it is an area that has not received much close 
examination until the last decade. Second, there are several different fields 
of inquiry that have- tended to develop distinctly different perspectives on 
educational knowledge utilization.- In terms of organized conceptual and metho- 
dological approaches that are acjcompanied by empirical data, the four mos-t pro- 
minant fields of inquiry are: 

J. Communication and knowledge utilization by educational researchers. 

.2. Communication and knowledge utilization by educational 
practitioners, administrative, and governance groups. 

3. Planned change or problem solving. 

*■'■■■■* 

4. Marketing/adoption of products/programs. 

, Each of these f.i elds tends to view the ^ucational knowledge base quite 
differently. In terms of the kinds of knowledge deplcted .in Figure 3, page 17, 
the first knowledge utilization field listed above, communication and use by 
educational researchers, is concerned primarily with just the upper right hand 
section of Figure 3, labeled "Research-Based Knowledge." The second know- 
ledge utilization field, communication and use by practitioners and others, is 
in fact, concerned with the entire knowledge base, i.e., all of Figure 3. The 
planned change or problem-sol v?hg field may . also encompass the entirety of l;ig- 
ure 3, but it tends to focus primari Jy on the middle coslumn of Figm^ 3, 
. i.e., on validated programs, promising practices and general practice. The 
fourth field, marketing /adoption'of products or programs, tends to focus 
primarily on the upper left hand quadrant of Figure 3, i.e., on R&D Products, 
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the more successful non-R&D products, and on the more tangible , types of vali- 
dated programs or promising pract'ices. 

These fields, of "inquiry also differ in their view of the social unit that 
is considered as the "user." The first two focus primarily on individuals, 
either researchers or others, who search for, acquire, and apply knowledge to 
. meet their own needs, or who pass the knowledge 'along "as is" or transformed in 
some way to others. The last two fields of inquiry may also focus on indivi- 

li ■ * ■ • A 

duals, bflt more likely they will focus on groups or organizations/ or their . ;/ 
representatives. However, there is one profound difference between these last 
two in the data the/ provide about "users." The planned change or problem-solving 
, . perspective usually focuses on a specificH ser (individual , group or organization); 
while the marketing/adoption perspective i/ almost always concerned with aggre- 
gate data concerning classes of users rather 'than with specific users. ' :: 
. * Because of these differences in focuK^op different aspects of4he educa- 

. tional knm/ledge base and in conception^ of the "user," '^each field has developed - 
Its own cqncept'tons^nd data regarding knowledge utilization. / These are summari-j' 
zed briefly below. The communication and utilization studies/of researchers and : ' 
of practitioners \are described more completely in Appendices A and B. 
— . Communfcation and knowledge utilization by educational researchers . This 
. field of study derives its concepts arid methodologies from a substantial body 
of research on* scientific communication and from studies of information needs 
and use in areas such as science, engineering and psychology. Studies in educa- 
tion have focused almost exclusively on active researchers (not development, 
dissemination or eval uatipn personnel ) who publish or attend national meetings. 
Substantial data exist .that describe the formal and informal search for, use, 
and exchange of information in connection with the various stages of a research 
project, presentation at national meetings, and publication in professional 
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jqurnals. In general, the image that emerges is that the scientif i<i communica; 
t ion system in educational research does not differ greatly from other disci- 
-pHne s-j-btit-th^a t-do es-se em-ta- i7rvoTve~-much-mo^^ 

less frequent informal communication among researchers in the same research 
area, longer delays in reporting and referencing reports, greater dispersion 
in- journal focus, and l^ss evidence of search for previous research results 
. -during. ppojecf planning phases. The image of util ization~ is closely associated 
with the stages of a research project, (See Appendix A..) 

Comniunication and knowledge utilization by pr actitioners.^ administrative^ 
-^^and go veijja nce groups . This field of study has derived its concepts and metho- 
dologies from user needs studies in library and informationscience. ^Because 
practitioners' and others^ needs for^.information are often not associated with 
anything as well defined as "projects" and may never result in formal presenta- 
tions or publications, many of the methods used to' study communication and knoW' 
ledge utilization among educational researchers cannot be used. Typically, one 
of two study approaches is employed. Clients or subscribers of specific ser- 
vices are studied, or, alternately, random samples of defined user groups are 
studied, jhe two types of studies tend to produce ma'rkedly different findings 
that may be characterized most succi nctly as findings concerning "users" and 
"non-users." ' ' ^ 
The. general image that emerges from over a dozen major surveys is that 
practitioners and other educational information users require relatively small 
amounts of infonnation from^a large>, highly diverse body of information. Most 
users have seriously restr^ctedtiife for gathering and using the infonnation. 
^Moreover, the oi^g^nizati^j^^i al •, and cultural systems provide them with 
few rewards for ^highly^yst^Sic'l^rch and use;- hence motivation for seeking 
and use is often low. Generally, the local, easily accessible, anb typically . 



^ personal source^ are used In preference to more 'distant, iriaccessibVe or formal .1 
sourcfes. W>thjn a general pattern of use of different sources, there are signi- 
ficant differences according to the individual's position or role. However, 
individuals,.with manifestly different work activities, requiring different 
types of ..Infonnation , and . with markedly different preferences for types of 
. infoirmation sources, display remarkable similarities in the.reasons they give / 

for their preferences for different sources. Regardless of the source prefer- 
^retl, most are.Jikely to tura to this source because it is: 1) likely to have the 
Wanted infonnation, .2) near at hand or accessible, .3) responsive to the indivi- 
; duaV.s problem or question, 4) easy to use, and 5) usually available when needed.' 
t'--- Among different user ' positions there are significant differences in need 
for information for different purposes, thus confirming the obvious assumption 
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that different types of users (e.g.,. teachers, administrators, school boartl 
membisrs) would have different purposes for seeking information. Factor analy- 
sis jndicates th^t there are perhaps as many as eight very general 'clusters 
of purposes for seeking educational information. These are: 1) to improve 
one's own work by keeping aware of what others are doing, 2) to identify new 
sources of assistance or new competencies, 3) to evaluate or make specific 
decisions about educational practices or products, ^4) to make or set ediica- 
. tional fJolicy, 5) to find answers, support decisions, or develop alternatives, • 

6) tosupport scholarship (e.g., to gain theoretical information or to prepare 
' formal reports) to teach and maintain instructional competence, and 8) to 

provide information to others. Several of these clusters 'of purposes for seek- ' 
^ ing information touch on educational improvement, but from, a variety of direc- 
tions. ; \ ^ ' 

Despite significant differenc.es among, practitioners and others in their 
need „fbr Jpformation for different purposes, a strong general pattern tends to 
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characterize most user groups; Overall, the-purpose which shows the greatest 
need for ififorrnation is keeping aware of developments and activities in educa- 
"t-i ony-::tl^e^^second-mb st:^ T 



to questions in. relation to the individual's own work'. Identifying new sources 
of a^ssi stance for improving one's own work and developing alternative approaches 
to Solving problems are also high needs. . 

Aside from general information about^^fcj^quency of use of different sources 
or user's ratings of importance of information for different purposes, there 
. i's relatively little information concerning actual use or benefit. ^ When 
. specific services are traced for benefit or impact the. results are sometime~'s' 
diffuse. In one cl assical eval uation of an information service approximately 
60 percent of a group of over 600 clients could identify no specific use. and few 
other benefits derived from the service. However, when* one focuses on crifical 
^incidents of information use involving. any source, rather than one specific 
source* or service, a» decidely different picture emerges* For instance, one 
^nationwide $urvey of many different types of information users indicates that 

virtually all those interviewed v/ere heavily engaged in responding to requests 

• • ■ ' 

for information and spent substantial amounts of their time responding to such 
requests. This study suggests that the information requester may not be, and - 
most probably is not^ the ultimate end user.. ^ 

jgrurther cpnfounding the issue of impact assessment especially when it is . 
confined to specific sources or services, are two facts. First, mostpracti- 
i! tiQn|^. tend to search more than one source when seeking information that they 
really rt^q;^^and,Vo,^^ report that several types or 

ourc^ of information were igfl uential . or appl i cable to the use they report, 
^risequ^tly assocla-tion of a $p6cific source with a specific use/benefit is 
difficultv Second, users tend to/employ different types of sources for different 



ERIC 



34 ^ ^ . / 



purposes. Hence studies that 'focus on users of specific types of services 
may derive highly biased impressions of the impact of knowledge utilization. 
- For example, users who prepare classroom material s _and are alert to new ideas, 
sources or methods tend to make greater use of information centers, libraries, 
text and reference books, journals, abstracts and indexes. In short, these 
types of users tend to use the types of' knowl edge (base) formats that come 
under bfbl iographic_control and that are most easily indexed by existing know- 
ledge base or 'fomral dissemination system "indicators. By contrast, those who 
seek information to set policy or support* decisions tend to use face-to-face 
communication, the telephone or correspondence in preference to more formal 
sources';' Since the use of these informal media is rarely studied in education, 
it is easy to miss many policy app^Vications. 

^ The image of knowledge utilization by practitioners is thus a fuzzy one. 
Knowledge is used for very many different purposes. Most of the information 
fs locally based and informal in character. When individuals do search beyond 
"personal and, local sources for information they really need, they tend to use 
more than one source. Aside from instructional staff, who *do tend to use libra- 
ries and bibl iographic^ sources, most individuals rely heavily on information 
that is provided by others. Hence, if there ever was a formal source, it may 
•be several steps removed from tbe ultimate user o* the information. Multiple 
purposes, multiple sources, and the chain of hiiman intermediaries confound 
efforts to gauge knowledge impact. But perhaps the most profound problem lies 
in our 1 imited conceptions of knowledg\e utilization. Most knowledge utilization 
in education is not clearly associated with "pJ^oblem solving" or "decision mak- 
ing" or "planned ofrange," except perhaps at the microscopic' level of day-to-day 
work acttvH^tfe's. Much knowledge is. used to keep aware o^f developments and ac- 
tlvitieS^'in education, to find answers to specific questions arising in relation 
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to work, to locate information to provide to others, and to identify new ideas, 
methods, or. procedures.. "Copjng" and "improvement" are major themes in the 
reasons that practitioners give for seeking information, but the effect of knowl- 
edge utilization tends to be so multi-faceted, sjubtle and incremental, tif&t much 
of its impact and benefit is often missed or ignored. 

However, when we move to the "macro" level of knowledge util izati on, and^ 
especially when we deal with more organized forms of knowledje/and its utilizati 
we encounter decidely more structured images. Ifhese are described in the follow- 
ing, sections. 

The planned change and problem-- solving perspective . In the field of edu- 
cation this perspective has been popularized by Havelock {1969)iunder the label 
Problem Solver (PS) perspective. In this perspective, the user initiates the 
process of change by identifying an area of concern or by sensing a need for 
change. Once the problem area is identified, the user may attempt to alter the 
situation either by him/herself or by seeking outside assistance. Lewin (1952) 
identified three major stages: Unfreezing, Moving, and Freezing. Each major 
Stage involves a sequence of activities, e.g., the moving stage involves the 
formation of an actio||>idea, including "reconnaisance" of goals and "means, this 
leads to th6'' formulation of a general plan, and then a sequence of action steps, 
each involving examination of results and making decisions concerning subsequent 
steps. ' 

Fifteen years after Lewin' s'formuTation, Miles and Lake (1967) described a ' 
strategy foK planning self renewal in schools that involved the following ex- 
plicit stages: 1) clarify expectations about program, 2) collect information, ^ 
3^ formulate goals, 4a) problem sensing, 4b) ditgnosing, 4c) set chang6;^arget 
and objectives, 4d) locate or invent solutions, 4e) weigh cost and gain, 
•4f) decide on alternatives 4g) plan toomplement, 5) carry out plans, 

'5! 



36 

6) institutionalize the self-renewal process, 7) phase out external assistance, 
8) assess continuing activity, 9) feedback to participants, and ,10) disseminate 
to others. Havelock (1969, p. 10-56) compares the planned change phases that 
have been identified by ten authors.- There are substantial similarities with 
some important differences. The Miles , and Lake formulation appears to be one 
of the most qomprehensive li-n scope and in the detail of its articulation. 

Ha.Yetock (1969),'Sashkin, et.al. (197S) Glaser, et al, (1976), Zaltman, 
Flono, and Sikorski (1977), and Hood and Gates (1978) provide succinct summaries 
of various planned, change and problem-solving models. Although there are many 
differences among these models, they all tend' to refJresent specialized. forms 
of knowledge utilizat^ob in v/hich knowledge is employed in highly Organized ways, 
and often with external technical assistance, to initiate, facilitate; or sup- 
port major problem-solving or planned change efforts in individuals, groups or 
organizations. These efforts may range from short-term Attempts to deal with 
specific problems to long-term efforts to change^entire organizations or insti- 
tutions. Because different social levels (e.g., individual ; -group, sub-unit, 
organization) may be ihe tar^t of the ehange effo'Pt, and' because 'd^ifferent 
time frames and change strategies are employed, there is a bewildering variety 
of methods and models. 'However, all these approaches sh^re a cornmon focus in 
concentrating on the conditions, problems and needs of specific clients (indi- 
viduals, groups or organizations). Both ffiternal and external sources of know- 
ledge arfe employed. Each model tends to view the' knowledge utilization process 
in terms of a progression of util ization stages that may be idea]^*zed as lin- 
ear,^but in practice are found to occur simultaneously or overlapping one 
another, often in different sequences from that prescribed by the idealized > 
model, and often in cyclical or nested patterns. 
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Marketing/adoption of products .or programs , ^hlle the planned change and r 
problem-solving perspectives focus primarily on specific clients and may employ 
j a wide variety of sforms of knowledge, the marketing/adoption perspectives tend 

to focus on a specific product, program or innovation, and tend to treat 'poten-' 
I tTal users of these organized forms of knowledge as classes or aggregates rather 

^ than as specific clients. 

Three conceptions, are commonly encountered. These are: 1) the Marketing 
Model, 2) the Social Interaction Diffusion (SID^ Model , and 3) the Concerns- 
Based Adoption Model (CBAM). Utilization af educational products and the more 
J tangible types of educational programs 1s often considered within a marketing 

framework. However, as educational products become more complex, intangible, 
/ and interactive, J;hey shade into the second col umn depicted in FigtTfe 3 (p. 17). 

Here we encounter educational programs and practices that may or may not contain 
. * products^ Although a marketing perspective may still be applied, the Social 

Interaction Diffusion or the Concerns-Based Adoption Models are more frequently 
employed. All three models tend to focus on a particular, externally developed 
Innovation or class of innovations (e.g., particular educational materials, 
pirograms, processes or structural arrangements), and tend to be concerned with 
Individual decision maker^s. The Marketing and the Social Interaction-Diffusion 
Models fpcus primarily onfaggregates of individual decision makers (e.g., 
market segments, laotential adopters, early adopters); the CBAM perspective 
also focuses on indlYlduafls, but within the context of adopting organizations. 

Marketing Model . Utilizatibn of tangible educational products is now 
frequently considered within a marketing framework (e.g.. Hood, 1970; Sikorski 
and Hutchins, 1974; Kotler, Calder, Sternthan, and Tybout, 1977). Fundamental 
to the marketing approach is the definition and analysis of the needs' of poten- 
tial users as a basis for product development and dissemination. Application 
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of the approach usu^llyj but not always, assumes the existence of a sufficient- 
ly large number of consumer^ to justify a high initial development and distri- ' 
bution cost. On the basis of market research pertaining to' user behavior, ho- 
mo^enij^s (segmented) markets are>.identified and specific products, price, 
channel, and pranotional strategies are developed to satisfy the needs of par- 
ticular market segments. Producfutil iZation indicators may include measures of: 
prodiKt awareness, disposition toward the product (e.g, attitude toward, inten- 
tion to adopt),, tri^l , adoption, iniplementation and initial use, and continuation 
^ (e»g., brand, loyalty, product ^witching). The use and interpretation of these 
indicators are significantly conditioned by the product's life cycle, e.g., 
when a product is initially disseminated, the focus may be on measures of con- 
sumer awareness, favorable disposition,, intention to try -the product. In later 
stages, rate of adoption anclTshare oV'the market may become key indicators. 
In some cases efforts may be made to measure user satisfaction or user percep- 
tions of costs and benefits. 

The social interaction diffusion^ (SID) perspective has its roots in anthropo- 
logical studies of the diffusion of cultural traits and/in sociological studies 
of the diffusion of innovations (Rogers*, 1962; Robertson, 1971, Zaltman a'nd 

Brooker, 1971; Rogers and ShoemaWr7^1971 ). In contrast to the product^inarketin^' 

■ ! iC \ 

perspective the SID pespective is markedly more- sensitive to the complex and * 

4 ■ 

intricate set of human relationships, societal and organizational substruc- 
tures, and communieation processes iwolve^^in the dissemination and early 
utilization 'phases. The various versions W the SID perspective tend to 
identify a similar series of stages (ZaWa'n, Florio, and Sikorski, 1977). . 
The initial irtipetus for change in individuals comes from awareness , perception, 
or t^cognition of a problem. A knowledge or information stage follows in which 
there is deliberate search for or accidental exposure to relevant information 



that helps to define the problem and relate it to one or more potential 
solutions. If enough interest is' generated, the individual seeks^more infor- 
mation that leads to comprehension , and "further understandirfq "b'f the 'innovation 
and to formation of attitudes , including a mental evaluation in terms of the 

* . . 

individual's own. Search criteria. If the innovation meets these criteria at 
least at a satisficing level, a trial stage may be entered in which the indivi- 
dual actually tries to use the innovation on a provisional basis. Following 
the trial, an adoption or rejection decision is made.* '.(Missing in most of 
these models, but evident in the CBAM perspective is attention to later stages 
following the d^^jsion to adopt.) Although this description suggests a nijtiear 
series of si:a|^^|^escriptions of . actual individual behavior suggest that varf- 
ous stages ii1ay:occijr simul.taneously, in different sequences, and sometimes with 
cyclical feedback and feedforward loqps. 

The Concer ns-Based Adoption Model (CBJ^l^) is a direct outgrowth, but signifi- 
cant extension of the social interaction diffusion perspective. (Hall, et al., 
1973, 1974). CBAM explicitly considers: (ajhow various participants in the same 
adoption activity may respond at various stages, (b) identifies several stages 
subsequent to the decision to adopt, (c) operational izes the identification of 
each utilization stage (levels of use) for individual bsers and (d) identifies' 
the concomitant user concerns. The basic hypothesis of CBAM is that the 
key to facilitating adoption of a change is guiding the client through various 
stages of concerns that are associated with different levels of use. The CBAM ; 
recognizes eight "levels of use," that are defined as "distinct states that 
represent observably different types of behavior and patterns of innovation use 
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* Later versibns of the SID perspective include a dissonance reduction, confir- 
mation, or resolution- stage in which the user seeks information to confirm the 
correctness of the decision. 
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as exhibited by individuals and groups. These levels characterize a user's ■ 
development in acquiring. new skills and varying use 'of the innovation. Each 
level encompasses. a range of behaviors, but is limited by a set -of "identifiable 
' decision points. The levels of use and their demarking decision points ar:e dis- 
played in Figure 4. . ' ■ " 

J\ssociated with each level of use (LOU) in CBAM are seven categories that 
serve to identify more jjrecTsely the LOU the user.occupies in terms of:' 1) know, 
ledge the usee possesses about the innovation, 2) information acquisition activity, 
3) irvformation sharing activity, 4) assessment activity, 5) planning activity, 
6) status reporting activity, and 7) performance actions and activities in 
operational izing the innovation. f ' 

We note that the SID and CBAM conceptions are complementary. SID tends 
to emphasize the diffusion processes and the utilization stages' prior to the- 
decision to adopt while CBAJjrt ends to emphasize the implementation^'stages' 
following thp decision to Wopt. Taken together iSlD and CBAM;>rdvide an ■ ' 
elaborate, empirically-based conception of how more complex, educational inno- 
vations are disseminated and used. ' . ' * 

Implications for Educational Knowledge Utilization Inllicatbrs ./ 

In the previous^ sections we have reviewed four major fields of Inquiry 
that have strongly influenced various conceptions of educational knowledge 
utilization. Each field is prone to its own kind of bias., The studies of 
communication and knowledge utilization by researchers are prone to focus pri- 
marily on RSD-based, forinal levels of knowledge, 1^ emphasize the more .formal, 
discipline based communication systems, a n'd to view upl ization as occuring 
within the context of an R&D project. Although it is obvious that this study 
area covers'only a very small portion of the total educational knowledge base 



• 41 



FIGURE 4 
CONCERNS-BASED ADOPTION MODEL 
ECISION POINTS LEVELS OF USE 



^- 0. NON-USE: State In which the user has 

little or no knowledge of the Inhovatlon 
and no Involvement* ] 



A. Takes action to learn about the Innovation, 



I. ORIENTATION: The user has acquired or Is 
acj)'u1r1ng Information about the Innovation 
or has explored or Is exploring Its'value 
orientation and Its demands upon user and 
user system. 



B. Makes a decision to use the Innovation by establishing a time to begin. 



II. PREPARATION: The user Is preparing to 
first use the 1nnovat1orj4 



C. Begins first use of the Innovation. 



Cb ' . III. «CHANICAL USE: User focuses most effort 



0 



Dl. A routine pattern Is established. 



on the short-term, day-to-day use of the 
Innovation with little time for reflection. 
Changes In use are made more to meet user 
needs than client [beneficiary] needs. The 
user Is primarily engaged In a stepwise 
attempt to master the tasks required to use 
the Innovation, often resulting In a dis- 
jointed and superficial use. 



IVa. ROUTINE: Us^e of the Innovation Is stabili- 
zed. Few If any changes are being made in 
|j>^. ongoing use. Little preparation or thought 

Is given to Improving Innovation use or its 
- . ^ consequences. 

02. Changes use of the Innovation based on formal or Informal evaluation In order to 
Increase client outcomes. 

IVb. REFINEMENT: .The user varies the use of the 
Innovation to Increase the Impact on clients 
, within Immediate sphere of Influence. Varl- 
' at Ions are based on knowledge of both short- 

and long-term consequences for clients. 

E. Indicates changes In use of Innovation based on jTnput and coordination with what 
colleagues are doing. 

V. INTEGRATION: The user Is combining own 
efforts to use the Innovation with related 
activities of colleagues to achieve a col- 
lective Impact on clients within the common/ 
% sphere of Influence. 

F. Begins exploring alternatives or major modifications of the Innovation presently 
In use. 

VI. RENEWAL: The user evaluates the quality of 
use of the Innovation; seeks major modifica- 
tions of or alternatives to present innova- 
tions to achieve 1ncreased«1mpact on clients; 
examines new development In the field and ex- 
plores new. posslblltles for self and t^e 
' system. 
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and posi'ibly ia even smal'ler portion of educational knowledge util ization ion- 
texts art environments/ we suspect 'that .the "R&D" conceptions of knowledg^ uti- 
lization may ^Wcise a subtle and largely unwarranted^Jn^Tuence on our. concepr 
tions of educational' practitioner knowledge utilization. We think this kind 
of influence may exist because these studies of communication|and use Jn R&D 
settings help t^describe, sometimes in great detail, what refearch (aind perhaps 
development and evaluation) personnel do'. It is then all to ^asy for researchers 
to generalize either normatively or prescriptively, to educat|oial practitioners.^ 

The educational marketing/adoption studies involve a'dif|^>|ent J^nd of 
bias. Unlike the R&D communication and utilization studies, theseXtudies do" 
deal wit-h practitioners as "consumers" or "adopter^<*^ However, the /obi em 
here is the narrow focus on only that part of the y^nowledge base that has been 
"organized" in product or program form, and on practitiofier utilization situa- 
tions where a product or program is "the answer." Jhe conceptual apparatus of 
the "communication' and ad^ion of innovations" 1 iteraturelhas become so powerful 
that the four-part DAG defirtdtion of dissemination includel "choice" and "imple- 
mentation" as the two dissemirtation levels that should nat|jral,ly follow "spread" 
and,, "exchange" (DAG, 1977). ^ \ 

We consider the planned change and problem solving field of inquiry/as one 
that is relatively much less biased in. its conception of knowledge utilization 

\ S'. ■. . . ■ * ■ 

since this approach may embrace much of the entire educational knowl edqe'^base ' 
and because it tends to address many significant aspects of educational prac- 
tice improvement. Unfortunately much of the literature in this field has tend- ^ 
ed to be prescriptive or, if descriptive, has tended to describe only the m^^"or 



Paisley (1971) explains how confusion between research disciplines and prac- 
titioner fj_elds has led to the selection or design of inappropriate informa- 
tion systeips in education. ; 



^ events and conditions concerning knoWtecige search, processing, and application. 
Details about exactly how all pertinent knowledge was acquired and used arc 
usually lacking. One consequence is that conceptions of the communication/ 
. dissemination system are often 11(^'ted ^nd usually tend to emphasize the par- 
ticular external or internal linkages that were established or facilitated by 

the activities of the change agent or consultant.: 

. . . ' ■ v ■ ■ 

The studies of information needs and use by educational practitioners can 

if . . * ' . 

serve as an important. complement to the .planned change and problem solving in- 
quiries, since the information needs studies have the potential capability of 
.encompassing all of the educational knowledge base and all aspects 'bf educa- 
tional knowledge utilization. The Ikisting studies in-tHis field of inquiry 
provide' Strong evidence that most educational knowledge; util izatibn is not 
concerned with adoptions, planned change or major types of problem ssolving. . 
The major defect most educational practioner information needs and use . 
studies are that they nearly always focus on individuals, and tend to cover a 
'•broad range^oT information* areas at relatively superficial levels. Currently 

available data fail to provide details about exactly how information is ac- 

» ■ 

quired and used and do not provide -much information about the organizational, 
group, social, or work contexts in which the information is used. Perhaps the 
most important direction that this particular field of inquiry^could take would 
be tou'^pursue in much greater detail the various major contexts and^urposes for 
which knowledge is sought and used. For example, what is the role and impact 
of knowledge in formulation and development of educational policy at any level 
of education? What* are the sources and uses of knowledge in developing or im- 
proving in-service training programs? 

It should be obvious that all four, fields of inquiry can be complementary. 
However, our major concern has been to point to the dangers and biases of viewing 

n 
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^ing educational ichdwledge .utilization -from any one of these perspectives. . All 
of them are* seriously incomplete in some way. 

How ctn we dimensionalize the field of educational knowledge utilization 
if there is 'no comprehensive conceptual framework? Review of the literature 
indicates that a very large number of dimensions may prpve useful, depending 
on the^focus or the level of detail .of the analysis. The following discussion 
will be prgianized around six major categories or dimensions: 
• ^ • Resource Type (knowledge input) / - 

• User Type /.v^"A^ v;. 

• Purpose . r;-' "'/'•^^•^^i-iv.;^" 

\ ■ ■>■ ■■■ ■ » .. •••• . . ". . 

• Scale, Scope, and Complexity ' '■■■'f.:}-^.^^-:!\7--' \'7:} 

• Stra.tegy,,.Yaetics7 and Complexity 

• Metiipcf of J^j%y^^;:'; 

Resource type. In= the previous sections on the dimensional analyses of 
the knowledge base and of the dissemination system, we consi*dered a number of 
dimensio/fe that may^ have- a relatively direct bearing on utilization, e.g., 
level of formality, format, type or degree of y^^^^ of knowledge, 

(products, programs, ideas), type of information service interface (print, 
human). The charracteri sties of how knowledge is organized and how it is - 
communicated need to be considered ip^a conceptual "mapping" of educational 
knowledge jitilizati on. In the immediately preceeding sections we have suggested 
some ways in which various fields of inquiry tend to emphasize or ignore differ- 
ent types of knowledge and different types of dissemination systems. When con- 
ceptions of education knowledge utilization are thus constrained or limited, 
they obviously can tell us only part of the total educational knowledge utiliza- 
tion story. We need to know what and how well different areas are covered; 
conversely, we need to know where we have little or no information. 

. . r. ■ Si 



^ " jgC types ^V We also; need td^ differentiate among di^^e^^^^^^ 
Previous research has amply demonstrated th^ there ^f^iiif^^^^^^ 
users of educational knowl edge that, may profoun^.|^^^ needs ' 

formation, the methods they employ in searcht^^nnfonfiation, ^'i^^ 
they coimionly rely on, the types of uses they make of the knowl e(fge they'^ob- . ' 
tain, and so on. Organizational , situational , and personal factors may be im- 
' ^. portant^^^^^ organization, (e^-g.^,^ education -agencyy R&D center, 

inten|^diate unit, local school), its location-, 'and the information environment 
... r, erf the orgai^ization are usual l^f important. Situational factors^ may include: the 
"'position arid role 6f the user (individual or groyp), the general nature of the, 
work performed, the work setting, the rewarli^control systems, the supervisory, 
pe€rr,.and aide informatipn^usgcommur^^ or 
^^^^ ; . a of informati^^Sj^^^l^s. '^r*sonal factors may include the: 

: or profession of the user, level of training, experience. with use of 

or other knowledge sources, status, stage of career, capabilities, 
J ■ w slarles^ information search and use styles, personality, and role in information 

transmission networks (e.g., gatekeeper, liaison, receiver, isolate). Depending 
on the level of detail of analysis some, perhaps\most , of theSe user typing 
variables may be important. Type of organization, type and leveji of position 
(or group or organizational unit), and type of task will near|^always be 
important factors that significantly affect knowl edge utiliz^lw^ 

Pjirgose. Organizational , situational and personal factors all tend to in- 
• fluence the specific purposes. or uses to which knowledge is applied. However,, 
because this complex dimension is ^o powerful in pr^edictrng or explaining know- 
ledge util ization behavior, we single it out for special cdnslderatioif. On pp 32- 
33 and in Appendix A and B we have presented some evidence of the general- effect 
of purposes on the rieed for or use of information. General functional areas 
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e^,, policymaking, governance, administration, instruction, research and eval- 
uation) and their various functional subareas tend to be the first or most powerful 
subdimensjon' for brganizing purposes, these functional' ^reas are' (roughly) crossed 
by general types of information use stages or phases (e.g., maintaining current 
awareness, ^owsing, developing background or orientation, comprehensive or 
selective search-, retrieval of specific data, facts, ideas; etc.) and by types 
of outputs (e.g., infoming others by alerting, answering, referring, teaching, 
advising; responding, reacting, or reporting to others; profrtcfting or opposing' 
ideas j positions, proposals or projects by proposing, defending, reinforcing, 
detracting; development of analyses,- pi ans, procedures, guidelines, instructions, 
appraisals, etc). This complex of functional areas, use phases and outputs /' 
tend to characterize or define the information use task or activity. Associated 
with these infbrmatlon use tasks or activities are specific requirements, re- 
lating to information needs or information outputs, such as: urgency of the 
requirement, scope and level detail, specificity, relevance^ accuracy, compre- 
hensiveness, cu'rrentness, rel iabil ity, authority or*credibil ity of the source, 
difficulty level or intell igibil ity , "entitlement,"* character, trustworthiness 
or proven capability of human resources. 

Scale, Scope, and Complexity * This area relates to the scale of effort 
and the scope and' complexity of action or impact that may be involved. We 
have previously noted that most knowledge util ization iiPthe field of educa- 
tion seems to be associated with the day-to-day work activities of individuals, 
but that substantial amounts. of the information that is acquired by one person 
^may be passed on in some form^to others. Even when we examine the planned 
change or problem solving, literature in the field education, we discover that 

* See Butler and Paisley (1978, pages 31 and 32). ^ ' 
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much- of it is focused on the individual or on small groups,. But. we. do find ^ 
examples of effor'ts to accompl ish planned change, at other^ social/organizational 
levels, such as the department, school building, local district, community 
levels, and in interorganizational relationships and structures. It is impor-" " 
^tant to know which level (s) may be designated aa- the- primary (and secondary) 
clients/users of information or.techfiical assistance products or services or 
targets of change efforts. At any particular level the numbers of clients, or 
beneftciary persons, groups or units; may vary greatly, as may the structure' 
and complexity of ^heiV relationships or interdependecies as social or organi- 
zational systems, other aspects of scope may include the size, duration, com- 
prehensfveness and continuity of the knowledge utilization activity, and its- 
relationship, '•interface," or coupling with units," work flows, related func- 
tions, or projects. , ' 

, -Strategy, tactics, and methods . Scope, ;scale, and complexity have another 
asp6%t that is related to the type, quality, and magnitude of knowledge respurces; 
and the frequency, duration and intensity of knowledge "inputs" that are avail-' 
able and 'that . can be applied or maintained in S particular utilization. Gener- ' 
ally, scope and scale of inputs will be related to scope and scale of application 
situations and of outcomes.^A highly important but sometimes ignored aspect of 
scope, scale, and complexity relates to the specific strategies,' tactics, or 
method^ that may be employed, i.e., the targeting, timifig, orchestration, and 
concentration (or diffuseness) ,of the utilization effort. The details relating 
to who, where, when, what, how,, how much, and what perceived intents or effects 
^'";^^^^i'".es critical aspects for the analysis of any information utilization 
situation. of even, modest scale, scope, or complexity. Hood'and Gates (1978), 
Zaltman, Florio, and Sikorski (1977), and Gl.aser, et al (1976) are convenient 
recent sources that prpwide orientations to the extensive literature on knowl- 
edge util ization strategies, tactics, and methods. " . 



— M ethods-4)^f-i^iQuj 

. npt--so much a set of dlmiensions for conceptual liring knfwiedge utilization as it 
a'^ set of dimensions for considering the methods or approacTfes for obtaining in- 
formation _aboirt educ 

■ Dlsciglinary paradigms . We haVe previously discussed the character of 
..several of ttie domi/ianll!^ of inquiry regarding educational knowledge uti- 
• lizatibn. Lurking behind these, fields of inquiry are several more fundamental 
aspects of inquiry. • Perhaps most basic are the various di'scipl inary orienta- 
tions that investigators may employ (e.g., human factors, social- psychological , 
industrial-organisational, sociological, politicaT sc'ience, information sci^ce). 
Each of these disc-l pi ines is generally characterized by a dominant paradigm 

that strongly influences the choice of units of analysis and variables considered, 

^ '/-^ ' ■ ■ ■ 

and the^ assumptions that are made about the role of wgrk^setting, tasks, indi- 
vidual s,vgrojjps, organizations and environments. For example,' the human factors 
investigator generally selects the information processing task as the unit of 
analysis and may select measuresr-of , performance' efficiency as the dependent 
variable. social , psychologist will generally select group£^' or individuals 
in groups as, the unit of analysis, 'and may focus, on attitudes; perceptions, 
behavior, or cognitive tiBSt scores as dependent variables.' The industrial- 
vorganizational scientist will tend to use indiv^uals as the unit of analysis 
and will tend tQ select communication or information use behavior ;or other per- 
formancfe measures as dependent variabiles. Sociologists may use groups or organi- 
zatiohs as the- unit^f analysis,- and may employ either individual variables aggre- 
gated to group or organizational levels, such as .information source useVates or 
proportion of adopters, W they rhay employ group-level or organizational-level 
variables,^ sSh as measures of group heterogeneity or cohesion or structural change 
in an organl^plpij^ as dependent variables, ^ach dis^plinary paradigm also tends 
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to ignore some aspects that may be considered of substantial importance to • 
other paradigms. For example, the sociological paradigm ^^^^ lignore indi- 
vidual differences that may be considered to be of great importance to the 
social psychological or industrial-organizational paradigms. Information pro- 
cessing^ task characteristics are highly important in the human factors and 
information sciences paradigms, but may be largely ignored in social psychologi- 
cal and sociological paradigms. Because these^paradigms strongly influence the 
nature of theorjf., the choice of variables, the methods of sampling and measure- 
ment, and the units and methods of. analysis, they act a^ powerful perceptual ^ 
and conceptual filters by limiting how we perceive and interpret knowledge 
utilization processes and by reinforcing the particular research or action per- 
spectives that are employed. 

Conclusion-oriented vs. decision-oriented inquiry . Disarip^ inary paradigms 
ar*e associated primarily with conclusion-oriented disciplined inquiry {Cranbachr 
and Suppes, 1969) or witiV what m^y be labelled as basic research or rtllitfameirtal 
research. Cronbach and Suppes have "introduced the cpncept of decision-oriented 
"disciplined" inquiry, to cover a range of more applied forms of inquiry including 

ied research, operations research, market research, and evaluation. Much' 
of the empirical work on educational knowledge utilization is derived from these 
decision-oriented forms of tnqui ry, rather than from, highly disciplined forms 
of conclusion^oriented inquiry. In. many cases, t]iis decision-oriented inquiry 
has adopted, explicity or implicitly, the perspectives and perhaps even the 
complete paradigms of one or more disciplines, but in other cases it is not 
clear that any particular paradigm^ha^ guided the inquiry. This lack of a 
coherent framework or paradigm makes it even harder to integrate the results 
of many §tudies ofp educational knowledge utilizatioji^. 
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Approachfts for d ev eloplI^entM>f--educat-ional-knw^edqe-uti^^^n^ 
Identification and recognition of the various forms of inquiry, "along 'with 
analysis and evaluation of the biases, strengths, and weaknesses that are inl 
herent in each can help griihy to make sense out of the mass (or mess) of 
available data thAight serve as knowledge utilization indicators. Unfortu- 
nately, when our interests are directed toward identifying or developing knowl- 
edge utilizations indicators that can be associated with units to be aggregated 
to local. State, or regional levels, we quickly discover -that there are very 
few reliable indicators of any kind that are available or that pan be easily 
created. 

Methodologically, there ar^ three general approaches to collecting utili- 
zation data. These are: 1) start from the point of distribution"(4istributor- 
down),,2) start with the ultimate user (user-up) or 3) start in the middle by 
^.tracing channels or mapping the flow of messages, products or services. Each 
approach has its own set of ^advantages and disadvantages. 

Distributor-down apprbaches. type' of approach is often used to assess 

usage or impact of particular products, programs, or services. Sales or service 
records may be obtained from distributors (e.g., the ERIC Document and Reproduce 
.tion Service, a Regional Laboratory, a commercial publisher, an. education 
information center) to ascertain volume of sales or services, geographic distri- 
bution, type of user, and perhaps other information about how the product, pro- 
gram, or service is being used. Among the problems encountered by this approach 
are: 1) inability to get the needed data from most distributors and 2)' the fact 
that a request or purchase does, not necessarily indicate actual use since a pro- 
duct or service may be used by several clients or may be purchased or requested 
and never used. Intensive follow-up studies of randomly selected samples of 
Cl ients/purchasers/adopter5 can develop useful information about actual use and 



perhaps even about client perceptions of benefits; however the first problem is 
^ not so easily solved* Many, perhaps, most, distributors of educationar knowledge 
riimply do not keep the k.i|ids of records that are required to identify users, 
except occasionally by.address. Even in these instances, extensive manual 
search of records at the distributors' offices is often required. One especial- 
; ly disquieting aspect of record keeping is that the quality of product/service 
records IS highly correlated with the kinds of products/services that are pro- 
vided. 'Butler and Paisley (1975), in site visits to 26 diverse educational 
linkage programs found that those linkage programs that emphasized information 
retrieval or publication services tended to keep extensive files on services 
provided,: number of publication units sent out, etc. However, programs that 
emphasized informal, interpersonal contacts (e.g., between the staff of a 
teacher center and its drop-in clientele) tended to be skeptical of the value 
of such record keeping and tended to evaluate their operations impressionistic 
cally on the basis of encounters with individual clients. 

Our conclusion is that distributor-down approaches are workable if one is' 

willing, a) to do substantial follow-up work tracing and contacting samples 

/ ' *^ 
I where adequ^e records can be found and, b) to recognize that the types of prp- 

— ^""7^ ' ■ - ■ ' ■ ' -. 

ducts, programs, or services that are being traced for utilization data may be 

# ■ ■ - 

peculiar and perhaps even highly biased samples of the more general classes 
of products, programs or services. > 

User-up approaches . Util ization" studies that start with carefully selec^d * 
samples of the ultimate user are able to overcome may of the problems inherent 
ia top-down approaches. However, there are respondent sampling pfroblems, e.g., 
should we include district level personnel (e.g., curriculum coordinators) 
builcMng level personnel (e.g., principals, counselors or librarians), or class- 
room personnel (e.g., teachers or instructional aides), or some combinations? 



selected level (s) of aggregation (e.g., regfonal , state, local)? 

are several other problems that may make the bottom-up approach 




difficuU. These include: 1) the high expense of collecting sufficient data 
to provide reliable estimates for ^ower levels of aggregation (e.g., state or 
local levels), 2) the problems (and expels) of overcoming non-response biases 
3) the problems of obtaining data clearance at federal, state, and even local 
levels, 4). the very general problem that many ultimate users may not k'now very 
much about the original sources of the knowledge they use or even about signi- 
Ticant intermediaries in a communication chain. This last situation may seri- * 
oqsly limit how far."up," or^^ow reliably one may be able to trace the relation 
between knowledge source(s) and ultimate users. When the ultimate user relies 
heavilj^ on personal contacts or is exposed to many relevant information sources 
"backtracking" can be difficult or even misleading. Moreover, in situations 
wt^ere one's attention is in fact directed to the assessment of the user of, 
specific types of knowledge or specific knowledge services, this approach may 
be highly inefficient, since typically, only a small fraction of any general 
type of information audience may be exposed to (andalso aware of the message, 
and source of) a partteui^ communication. Despite these difficulties, the 
user-up approach enjoys, at least potentially, the distinct advantage of deal- 
ing with users in their work and information environment contexts. One is 
thus less prone to find or believe that one source or service is sufficient to 
meet the user^s needs or to account for attributed benefits. 



* Without a^ressive and systematic follow-up, mail surveys of educational 
practitioners may achieve only a 50 to 60 percent response rate. Field 
surveys attain substantially higher. rates but at markedly increased costs 
pfer respondent. , 



Start-iir-t he-middle approaches . Rather than focusing on specific distri 



butors who happ^ to keep satisfactory records or on ultimate users who may- not 
know very well where their knowledge came from', one can focus 'on dissemination 
chanels in an effoVt^o map the- flow of knowledge through a chain of senders 
and receivers, e.g., by inter^ewing 1 nlermedi aries such as linking agents, 
change agents, or consultants, who know what products, practices, or programs are 
in use, where they originated or were obtained, to whom they were passed, how 
they are used, etc. The problems with this approacji are that: 1) it is subject 
knowledge-base, client-type, and response biases, 2) it requires substantial 
"triangu^ation" among different i ntermediary/ sources to' cover the various;' 
major channels that may be conduits for particular user groups "and-for^^rt't^;:- ' 
cular purpose/problem areas, 3) it requires substanti^T dati ^nterprk^afl^n' ^ ° 
arrd 4) for the above reasons, it tends to hie very expensive linless-confihed to 

- ■ ■• *; ■• ■■■ :° ■ • ■ / '■■ 

limited dissemination and" utilization domains (e.g.Vspecific type's oiP^nter- 
medianes, types of subject matter contenf "or UsefVoblems, ,ty|fe^ qf 'u^rs). 

. . ■ ■ ■ ■ ■ - ■ * :% . .'v 

Mixed approaches. Because there are probleJhs- wajfe'^^feach^^^ 
proaches, it; seems likley that a knowledge utMizatioi^|^sUent?«tiiat^ c** ' 
aspects Mr-two or all three of the above "apprbaches^'may" prove to-be si3^feiof' ^ 
to .ai^-bne type of approach..; For instance one'' mjght s^g^t/wittr -a- Survey If -V^.. .'' — 
ultimate users to -identify the major typies ;q,f'' interinedfaries thk seem to .be \ r " 
relevant for specific clients ind -speci fit:- t^^pes of 'JcnWtecfge ijfil izatoipr^ con- " v . . 
texts (e.g., problems, purposes), and thefi proceed to V surveylof t*lse identifjid 
types of intermjediaries who could provide fui^th^rjYifonnaViQn concerning ttreir 'ii- 
own knowledge sources, their clientsV.^their.c^^Ji^- tors, etc. Both .]BserS'>5:nd . 
intermediaries could be querri'ed- '^^^h^m^P} icat1.on^"?^rcei'vedninb-c^t arid/ " ' 
benefits, etc. Where more detailedn"nfonnat14rfi' was r^quiria\eonciern7hg the -* ' / ; ^ 
history, context, or impact of knowledge -use, onel<;ijul*d yse^liieSdata Ifr'om ncorc 



and intennediariies- to. identify-, and- select specific use situations for more in- 



tensive study. If these cases were selected randomly, projections to 

defined user- populations woul'd;be,4*arranted. . . 

'■■ The current reality. Currently most of our information about knowledqe 

- , ^Utilization is'extraneiy Tfmiteld. There is a massive amount of annecdotal and 

case study information,* but little of this information can be. used to assess 

systematicaTly; how.. any form of knbwlWge. is used on a nationwide, regionwide, 

■ .w'or^ even statewide basis. We can ,,i^entifyj in some cases, the users or sub- 

" scr^fbersi. of particular infohnj^tion publ ications %r services. Occasionally 

' ^ * ' -"^ ' . ^ 

these •puSlij^hers or service agencies "have conducted surveys of their subscribers 

'MbreoVen, in< f^ instances, such as the Evaluation of the .Na|ion- 
Diffusion Network.. (Efftrick, Peterson, and Agarwal a-Rogers, 1977) we are able 
So Identify ^R^mbeVs ^nd kin"a?W adopters by state and region. All o* these 
. Wbnnation^iiurces dgpend 0^ approach and are focused on one« 

• or more of . limit ej^. c^^^^^ programs or services. . ' 

'^AS'We ha^te notech, Surveys of users provide an alternate point of entry 
: fWas|essJ/icf..ut^^ To our knowledge, n6 nationwide probability sampl- 

. frig sib:tvey has;fbeen' conducted that reported on utilization by any geographic 
^asis,.»- 



. -./i • * Most educatfopal information use surveys have classified users by type of 

§gency,..,posit'i:on, or fole. Due to costs involved in sampling and in securing 
\>;L .c#eaf*ances- from educational officials in each state, many user surveys have 
sampled states and then subsampled agencies and persons in selected states. 
' Due to failure. to sample all states. and/or lack of sufficiently large samples to 
ai»f6rd reliable estimates*at state levels or local levels of aggregation, data" 
^-''"se.s; at these ^levels are rarely undertaken. The Education Market Study 
and Blackwell', 1976, Vol. I, p. IV-56) did consider geographic region 
as a.j3redrctor of use of. several types of information SQurces. When other 
key' p^-edictor variables were held constant, geographic location failed to add 
Siignificai!(t; incremental prediction. Consequently, the effect of geographic 
jocat^qnjyaS not pursued further in this study. However, these data could be 
• rearfalyzep?>t^ . develop crude state-level aggregates regarding practitioner 
ri'nformation ose'f dr . most, but not all "states. 



Many. studies of educational knowledge intermediaries exist, e.g., Butler 
and Paisley (1975) on education linkage programs; Katter and Hull (1976) on edu- 
cation information services; Madey, Mojowski, and Strang (1977) on State [educa- 
tion agency] Capacity Building Projec^^^T^tmrick, Peterson, and Agarwala-Rogers 
(1977) on NDN State Facilitators and Developer Demonstrators; Berman, PfcLaughlijij_ 



et al, (1975, 1977) on federal and ^t^ate agency roles in supporting local educa- 
tional change projects; the R&D Exchange (1978) on the dissemination and technical 
assistance activities of USOE RegioriaJ dffices, state, and intermediate education 
agencies; Lotto and Clark (1978) on the dissemination and utilization roles of 
schools, colleges, and departments of education.* However, only a few of 
these studies provide adequate information on user impact or benefit aside 
from impressionistic appraisals offered by the intermediaries. Even in those 
instances where utilization data exis|; most studies suffer one or more of the 
following defects: 1) th^ did not" cover the entire U.S., 2) the sample sizes 
are tod small to provide reliable estimates of aggregate measures of utiliza- 
tion Bt st^te or local levels, 3) probability sampling methods were not emf)loyed, 
or 4) data col lection methods were not su^.iciently standardized or rigorous -to 
assure uniform measurenient of all cases.** 



* The, content of these several studies are summarized in Hood (July 1978) or 
Emrjck afid Peterson (June 1?78). . 

** Among the^studies cited Emrick, Peterson, and Agarwala-Rogers (1977) comes 
closest'^^tb avoiding these defects, but it suffers from very small state- 
level sample sizes. 
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CONTEXT DIMENSIONS 



Conceptual mapping of the dimensions of context indicators presents 
special problems thal^^are different from those Confronted in mapping the pro- 
duction, dissemination, or atil ization domains. Selection of Context indica- 
tors should be based on hypotheses concerning causal or explanatory variables 
that may be related to other types of indicators or to relatjoaships among 
indicators . In general, context variables should represent -v'vaTr^'ables, forces 
or factors that may account for the distribution by geographical or education- 



al sectors of quanity, quality; content, or process characteristics, or other 
activities of selected production, dissemination, or utilization (PDU) indica- 
tors. ' 

The following are some of the major categories of context variables that 
may prove to be useful. 

Individual popihlation data. Population data on the numbers of persons 
(all persons in an area, school age groups, ethnic groups, number of elementary 
and secondary education- school staff, number of librarians, etc.) may be related 
to PDU indjcators. Folj higher levels of aggregation, (e.g., USOE regions or 
states) many of these population indicators are highly intercorrelated.* They 
can serve a^s "proxies" for indicators that may be less accessible^ (e.g. , numbers 
of university faculty that produceeducational documentation; number of educa- 
tional agency staff that serve as consultants; number of potential/'consumers" 
or "users" of educational knowledge). ' 



* It jnay be anticipated that atjower levels of aggregation (e.g., SMSA's), in- 
tercorrelations among population variables will be less. Attention to selec- 
^ s . tion of appropriate population /indicators (e.g., minorities, ^^ulty in schools 
X of education in public universities) will then be important. ^ 
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Demographic characteristics of^popuT^ations . These indicators are related to 
population counts, antf may be considered as population data. Examples might 
be the percentage of the population of an area that is minority, that has com- 
pleted high schools, that is below the poverty level, that is classified as 
non=urban_. Population density and distribution data maj^ also be relevant-to PDU 
indicators through their possible effect on social stimulation, communication, 
or the time and costs required to obtain or deliver personal services. - . * 

Economic data. Capacity to support PDU activity may be related to the 
economic resources of a region or more directly to measures of. the amounts 
of these resources that are allocated to education or specific educatibtial 
sectors or activities. In some cases it may be desirable to adjust economic 
data for differences in cost of living or purchasing power in different areas. 
'Adjustments-may also be needed °if data are aggregated over different ti<ne 
periods. 

Socioeconomic data . When population and economic c|ata are considered to- 
gether, various types of socip-economic indicators tnay be considered. Indica- 
tors ^af this type may be employed to exanfi he issues of opportunity for access 
or problems relating to different iial production or utilization. 

Socio-political dita .^ Conceiv^v. public opinion poll data, especially 
if pertaining to educational issues; and other types of measures of socia] » oH. ' 
political activity might be related to factors supporting or inhibi;^^ng changes " 
or. innovations in schools or to the level and type of PDU' ac^vity. Specific 
education-related activity of state legfslatures, boards- of education, or other 
social or political bodies may also be relevant (e.g., a state position on mini-* 
mal competency testing, or state-level support for local schodl improvement 
programs). ' ('^ . . 
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Educational agencies data . The numbers, types, characteristics, physical 

^ ^ -> ■ \ 

:^ocation, programs, services, functions, staffing, and funding of educational ^ 

agencies such as local education agencies, intermediate service agencies, state 

education agencies, collegers and universities, 1 ibraries* and information centers, 

teacher centers, professional associations, » may have a bearing on PDU indicators.* 

■ ■ ^ 

Implications for the Development of Contextual Indicators 

This is perhaps the only one of the four indicator/areas where there is 
an abu^ndair^ of easily accessible data aggregated conveniently at state and 
local levels, of aggregation. Federal sources for many demographic, social, 
and economic contextual indicators include the National Center for Educational 
Statistics, the Bureau of the' Census, Bureau of Labor Statistics, National _^ 
Center for Health Statistics, and Statistical Reporting Service of the Depart- 
ment of Agriculture. Although there may bfe problems in obtaining data dis- 
aggregated to state or local levels, other potential sources specific to edu- 
cation include statistical data collected b^^ educationa] associations, e.g., 
American Council on Education, National Education Association, American 
Educational Research Association; opinion polling firms, e.g., the Gallup 
Poll, National Opinion Research Center; and various specific educational sur- 
veys, e.g.. National Assessment of Educational Progress (NAEP),- the National 
Longitudial Study of Educational Effects (Project Talent), NCES Surveys of 
Educational Institutions, the NIE/NASSP Survey of Secondary School Principals, 
the Bureau of the Census Current Population Survey (CPS)' and Survey of Income 
and Education (SIE), the NEA Survey of the American Public School Teacher. 



♦When considering educational agency data the distinction between a context 
indicator and P,D, or U indicators may depend on the specific situation, 
e.g., the number of intermediate units in'a state might be used as a dissem- 
ination structure, indicator or as a context •indicator. 



ERJC 63 



•■■ 6a;;. 

♦ ■ ■ *■ . ■' ■ 

Finally, there appears to.be some potential for reanalysis of some existing 
data sets, e.g., the Evaluation of. the National Diffusion Network (Emrick, 
( Peterson, and Agarwala-Rogers, 1977) or the Education Market Survey {>iood, 
Mick, and Katter, 1976). . - ^ ; 




/ 
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EXPLORATORY DATA ApLYSES 



; ..... 

. Can the conceptual ..framework presented above help in designing and inter- 
preting studies of educational knowledge production, dissemination, and utiliza- 
tion? We believe the answer is a definite, yes. The framework provides a multi- 
dimensional "sampling sptce" in which various. indicators (independent or de- 
pendent variables) may be mappe^l. ' When indicators are mapped in this conceptual 
sampling space, it often becomes apparent that only small ■part(s) of the space 
are sampled, and often in peculiar densities. Sometimes it is possible to find 
or develop additional indicators in order to provide better coverage of the ' 
region that is undeP»consideration. , When this is not possible, one at least 
has some sense of probable 1 imits for generalization of findings. 

The framework can' also be quite useful in suggesting ways to refine aggre^ . 
I indicators 'and in' considering ways to cross classify various types of in- 

The results of several lines of exploratory data analyses are described in 
two recent EDSSP reports. 

State and regional analyses . Hood arid BlackwelT (1979) examined selected 
/ state-level and region-level P^ofiuction, dissemination, and context, indicators 
to answer the following questions: / 

% How are selected indicators distributed among the states and 
regions? 

• What is the relationship among indicators within sets? Can 

more parsimonious factor scores, be created in order to reduce . • 
the number of indicators within sets?. ^ 
■ ^ .■ . - - .• . .. ^ . • 

What is the relationship of i^tdicators or indicator factor 




scores across sets? More particularly, to what extent can 
contextual indicators be lised to predict or account for vari- 
ation among states or regions in thfeir knowledge production 
or knowledge dissemination indicators? If .so, what do these 
predictions tell Lis? Perhaps as important, w^here do.we fail 
to predict? What new tndicators are deeded? ^'^ 



• . Can tliese indicator^ be employed to create typologies of 
states that may be useful for disseminatjo'n planning or 

~^aTiaTysTs"?""~ . • • ^ " ~~~ 

The data analyses* demonstrate that there are substantial and itiieanlngful 
differences among the^. regions and 'the states ^in the quanities of educational, 
reports and journal- articles that they produce, in the document SBjarch services 
and repositories that are available, and in a variety of human linkage and dis- 
semination technical assistance services that are provided. States and regions 
are also markedly different on--jfiany^contextual indicators. Factor analyses ' 
produced a smaller number of contextual indicator factor scores that. can be 
employed to account for significant amounts of the between state variation in 
a}]^^ thirteen knov;ledge production and^ dissemination indicators that'were 
used in this exploratory study. Explained variances ranged from 15 percent to 
79 percent. Educational system. size and expenditures for education are especi- 
ally powerful contextual factors that account for over 60 percent of the state- 

to-state variation in all indicators that are based on counts (e.g. , documents 

# '. ' 

produced, search services, JDRP 'approved projects). Other contextual factors 

L ' ^ . ■ . /■ ■ . ■ ■ 

that add very modest increments of predict! ve variance, especial ly for qUali- 

■♦ _ 

tative indicators of dissemination capacity, include': 'presence and distribution 
of intermediate service agencies and teacher centers, population and school^ 
system density and population change. Prediction tended to be o best for document- 
oriented dissemination servi'c 
existence or status of a SEA 
Validation, Dissemination (IVD) process. Some specific results based on multiple . 
regression analyses of data for the 50 states and the District of Columbia are: 

• Three contextual factors' account for between state variation 
in the number of RIE documents ,in ERIC that were produced in 
each state. Size of the educational system accounts for 66 , 
percent of the cpvariance, educational expenditures adds 9 
. percent and population density adds one percent. / 



es arid poorest for qualitative indicators such as 



state dissemination plan or an Identification, 



• Number of ERIC search services available in each state are 
•Also predicted primarily by size- (55%), and educational ex- 
penditures ray; but teacher centers," intennediate service 

. centers, and^eater expenditure on education relative to 
per capita income adcl^ a small increment; (4%). 

• R&D Ut1lfzat1or» Project/1 inking agent numbers are rrot strongly- 
predicted (32% tot^l covariance); the predictors include: 

vsize (16%), distribution of intermediate service agencies 
. . ; . (-13%), educational expenditures (2%) and population increase 
: > . - (1%). '. > . 

The report demonstrates that indicators can be used to create typologies 
of states on the basis of a) contextual factors or .bj dissemination structure 
indicators. The typologies,, although based on completely independent .sets of 
indicators, result in a similar typing of most states. The typologies appear 
to be useful fpr selecting states for comparative case study. Analysis at the 
regional level indicates that th$ ten USOE regions also tend' to -di-f f er on many 
of the same contextual, production and dissemination indicators, thus suggest- 
ing that there are major regional effects that operate either directly on edu- 
cational knowledge production and dissemination' or on underlying contextual 
factors. ' • ' ^ ' " ' 

Data base and metropolitan/rural area analyses . Paisley, Cirksena, and 
Butler (1979) analyzed a. number of 'indicators in two exploratory studies of 
information equity .for five group6 (migrants, rural, women, disabled, and 
minorities) . . 

The first study examines the ERIC data base by cross-classification on 
two dimensions, a) .subject matter Content and b) audience orientation (a sub- 
dimension Of the knowledge organization dimension).;' The ERI^ data base analy- 
sis suggests' that the literature pertaining to some groups my have less depth 
and breath, documenttvfor dopument, -than literature pertaining to other groups. 

The second equity issues sfudy examined the geographical distribution of 
informatiQ/i. programs. The remarkable methodological aspect of this study is 
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that it if based on 334 SMSA/Rural Areas' and on 251 SMSAs.* Although extensive 
census and ..educational statistical data are avail able at the SMSA level, the 
ingeneous part of this study was the creation of a reference file of SMSAs and 
rural area aggregates to which sets of thre^digit postal .ZIP prefixes could 

'^^^ prefix, various data on information sources 
users,** colleges and .universities, and^ate capitals were f4x,ed as^o geo- 
. graphic, location. ' ?f • ' ; 

Among. the interesting- findings are the following: 

• Theinfluence of urbanism (also found by Hood and Blackwell 

in their. analyses^t statf and regional levels of aggregation) 
Is evident in the fact that larger numbers' of resources and 
} users are found in larger cities. However, the presence of 
colleges and the location of the state capital also accounts 
for more information programs, more ERIC collections and more 
users among smaller SMSAs. 

» 

• The proportion of resources and the proportion , of , users are 
not distributed in proportion to populations. It is in SMSA 
larger than one million, where 56 percent of the total num- 
ber of educational dissemination programs serve 41 percent 
of the population, and in rural areas, where 11 percent of 
the programs serve 27 percent of the population, that the dis- 
proportion is -greatest. However, ihe number of ERIC collec- 
tions is proportionately greater than population on all SMSAs 
smaller than one million. (The stronger correlation involv- 
ing ERIC collections is not with population but with presence- 
of coll€»es. and universities.) ^ 




A sut^aWiy of the distribution of women's resources shows 
a markeo^ndency for thes^ resources to be concentrated in 
the larger SMSAs and for the majority of smaller SMSAs 
rural areas to have no women's resources. 




Multiple regression analyses show that 66 .percent of the 

variance in the number of information programs in 334 SMSA/ 
rural areas is predicted by three variables. Number of users 
alone ac,counts for 53 percent. Colleges and universities- 



* SMSAs - Standard Metropolitan Statistical Areas ' 

*♦ Users iff this analysis are person residing in each SMSA/rural area Who were 
/ ,.;;1dentified in samples drawn from th6 mailing lists of five national informa- 
^ :t ion programs. 




account for another 8 percent and' state capitals add 5 per- 
cent* The fourth variable, urban size, adds nothing. When 
only the 251 SMSAs are analyzed, the covariance rises to 72 
Ijprcent, 

' ' , ' > *.' " 

• Predicton of the numbier of ERIC collections available in 334 
SMSA/rural areas shows that number of colleges/universities 
in the area accounts for 60 percent of the covariance, and 
number users add, 8 percent. Location of state capital and 
urbanism add nothing. When the 251 SMSAs alone are examined' ? 
numbers of users is the most powerful predictor, accounting 
foY* 67 percent of the covariance, number of colleges and uni- 
versities adds anothier 10 percent and location of state capital 
adds 2 percent. ^ ' 

Other studies. The EDSSP staff are pursuing or planning several lines of 
investigation, including: ' ' . 

A. Further study of geographic distribution and relationships among 
indicators at three levels of aggregation— regional , state, and SMSAs. 

B. further examination of data pn.the distribution of, and services pro- 
vided to, special populations (e.g., minorities, handicapped, geograph- 
ically isolated). ' 

C. Development of indicators of utilization, and' examination of their 

^ use as "dependent" variables in time series analyses of state by state 
trends and .their causal determinants. / 

D. Development, .and analysis df^^the realiability of and use of subjective 
indicators (e.g., judgemental ratings of. relatively intangible quali- 

' ties^such as "dissemination leadership," or "technical effectiveness"). 
^^'^^^^^^.^^^^^-^l'^^^^ predictive or causal models designed to 
_accdi(^?or* ceglb'rjal' .Jdr state Vajriance In dissemination or utilization 
-iwJic'^rs.' v' 
, F. "Sensitivity arfalysis of .the st^i.Hty of model parameter estimates. 
G. Examfnation of residual crrVq!ut,fier cases to attempt to account for 
^/fe reasons for poor fit between data and the predictive models. 



CONCLUSIOfT 



Most data and information on educational knowledge production, dissemina- 
tion, and utilization (KPDU) are found in specific researach projects, case 
studies, .purveys, or program^evalaations that are usually confined to well de- 
fined and often limited areas of investigatiort. When one attempts to organize 
the findings^ from these severaT sources within a comprehensive conceptualization 
■ of KPQU theije are diff icirTties in establishing the boundaries of the area of 
investigation or the most important organizing parameters. or dimensions that 
should be considered. Moreover, efforts to synthesize findings of various edu- 

* ' ■ 

cational KPDU studies are seriously hampered because we lack an acceptable 
framework for establishing similarities and differences along sigi^ificant dimen- 
sions or* for determining how adequately various dimensions are represented. 
And we have no good basis for indentifying major gaps in the field of knowledge 
of KPDU. Finally, we run the risk of overgeneral izi ng from results that may 
inf act pertain to very limited KPDU area's. :Jf 

These, problems beset anyone who attempts to make sense of, or act on, 
•existing knowledge pertaining to educational KPDU. They are particularly ex- 
acerbating to tfiose who attempt to develop ^d interpret KPDU indicators. 

There are many disciplines, paradigms, .perspefctives, theories, models, 

and other conceptual systems for viewing. educational KPDU.* Given the immense 

J - 

complexity of this field, we view this diversity positively,' and see no hope or 
need for achieving one overarching, conceptual framework that would replace or 



* Pertinent references have been cited throughout this paper. For comprehensive 
overviews with discussions see: Havelock (1969), Rogers and Shoanaker (1971) 
Gross, Giacquinta and Berstein (1971), Havelock and Lingwood (1973), Short 
(1973), Shashkin, et al (1973), Galser, et al (1976), Nash and Culbertson 
(1977), Zaltmap, Flor^o, and Sikorski (1977), and-Hood and Gates (1978). 
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intergrate all others. However, th^re is need for some kind of a taxonomic - 
scheme to aid in sorting out and Organizing the empirical contributions of 
the various theories^ models, disciplines and paradigms that have been or might 
be employed, "and for organizing other data that have no apparent conceptual 



framework. 



V 



, The framework offered in this paper represents an initial attempt to iden- 
tify some taxonomic dimensiojps that seem to organize most powerfully and prac- 
tically the-iany facets of educatio/al KPDU. The dimensions that have been 
presented are listed schematically in Figure 5. 



FIGURE 5 



DIMENSIONS OF EDUCATIONAL KNOWLEDGE PRODUCTION, DISSEMINATION AND UTILIZATION 
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Please note that these particular dimensions\have»been selicte<i;io 
basis of theS ability^ organize the complete dWin -of educatioria;! K^BiJv<ci>.!^^- 
.^data. Other conceptual frameworks may be far more useful for ■purs'uing specif.ic^^ " 
lines of inquiry within a particular paradigrrf. Hence, we- are not sugge^irfg . - ..' 
that this framework is anything more than a rel ativeiy^, comprehensive dimension* ■ '. 
al taxonorr\y that may be useful for organizing KPDU data or for planning {'he i • 
scope of new studies. >^ ' i 

Each of the- first three sets of dimensions (for knowledge base, dissem- 
ination structures, and utilization settings and outcomes) are self-contained, 
consequently there are, some partial redundancies across the dimensional sets. 
Note tiiat the full set of knowledge base dimeijf^ns may be considered in 
aaa1yi,ing the I'Input" resources. of the dissemination structures set, and for 
analyzing the "Resource Types" of the utilization set. The dissemination set 
and the utilization set are double linked, since analysis .of "Output" of the 
dissemination set may incorporate all of the dimensions of the utilization set, 
while- the "Resource Type" of the utilization set reflects the client's view of 
the dissemination structures' "Client Interface". and its "Outputs." Although 
these- 1 inkages exist, the redundancies are not complete, e.g., the "Outputs" of 
one or even several dissemination structures may not equal the full set of Resource 
Types of a particular utilization setting; the knowledge base that exists nationally 
is not the same as the base that is accessible to a particular dissemination service 
or a particular client group. For these reasons, we have del iberately retained 
overlaps in the dimensional sets. > . , . 

Note aTso that this entire set of dimensions focuses primarily on dissem- 
ination and' on utilization, "flffe knowledge production system is represented only 



■^"n terms Of. 'its knowledge base outputs.* ^ The«ten dimensions associated with 



' structures appear to be' the most complete^ hwJver the five di- 

■ .-.mensional classes of the^utilization set encompass many complex- sub-dimensions. 
; ; 'In various places throughout this paper we. have given examples of how.analy- 
A' sis in terms of these dimensiojis can inform us concerning our knowledge of educa- 
itional KPDU. For example, most of our detailed informat«»on about the edwc^Wonal 
knowledge base refers only to the more formal types of documents and /(laterial s 
that are indexed by national information systems^ We know very littMe about 
the content of knowledge that is communicated orally of informaljy. Although 
we know a great deal about the wide variety of kinds of educational /issemination 
services, we have very little comprehensive information about the r{ationwide 
distribution of most non-library services. In the utilization domain, we en- 
counter a similar situation, in which several lines of inquiry have produced a 
rich mass of desciptive information, but aside from relatively superficial sur- ( 

vey data, we lack any kind of accurate nationwide indicators of educational 

/ • .... 

knowledge utilization. 

, Despite these major problems concerning the availability of KPDU data, 

' * ■ 

exploratory studies s'Qggest that it is possible and useful to develop and 
^analyze KPDU indicator data at three levels of aggregation: regional, state, 
and local. The di^nsional taxonomy simply reminds us that there are sometimes 
severe limits on our^bility to generalize KPDU findings. ^ • 



^= 

* Note that there is no explicit point of input from dissemination or utiliza- 
tion to the knowledge base because this is an incomplete set that considers 
only the output! part of knowledge production rather than the entire produc- 
tion process. ^ 
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RESEARCHER-ORIENTED STUDIES OF EDUCATIONAL KNOWLEDGE 'cOMMUNrGATION^ AND UTILIZATION 

•Information cpncernfng kpowtedge utfliaatJon by educational R&D personnel. 
;comes priniarily frdm two/sources; analyses of formal aiid informal communication 
.,^'ehavior'pf educational researchers,; and/ user ^Tieeds studies which hav.e treated 



* - ;>^;_ig^"^^^^9"^^ ^esear cbeVs as one of several - subgroups. With a f^w excgRtions^! 
■.■J";/:-- ^oc«5;;;has been ofi researchers, as.oppose^to cleveropment./dissemfiia'tion. 



■ • or evaTuation personnel. 'Mwlover,' our informatiim iliypically biased toward ... 

more active- researchers %o' publ ish and itend , national ffl Although 
^ a substantial body of : research on information'Wls and use exists in areas ' 
■ V. .such as, science, fehgineering, and psychology, data' regarding communication and 
, -infonnatTon use- within educational R&D is relatively recent ^D^rshMer, 1970 
• , Nelsba, Garvey, and i:.in,M970; Nelson, 1970; 1972a, 1972b; Short, 1973). 

, .* . ■ -- The^ picture Qf Vnfortnation flow, that has begup to' emerge is generally simi- 

. . • , litp to that produced'.by other, studies, in the. s sciences (e.g. ; Jrittai'n, 
// . lVO; 'APA. 196ii Lin, Survey, and- rielsoh, 1970). '.These studies, which focus 

chiefly on annual profess iohal meetings and formal publications, pr(^vide the 




• -l;' l^e- scientific communi.cat i An s^9tem in educ'ation does" not ^^f 
\' differ greatly fpxn" other disciplines but lit does seem to, • - V: 

embrace much more ■raridom information "exchange. . ■ - .f . ^ 



■.„•.; x^'^. ■ :'. . "... * t'^'^-^-'- ■'■ ; ' - ' 

*w * of thi.s bias ..isi,.unknownjfeut m^y be gauged 'very roughly, by da'.ta 

" % ■ ' ■ tfie/.Qrigon Studies inTducational RDD&E TShalock, et al , pages , 

- t- y M^j!/SwJ^% ,perc^t of professioriftl RDDSt", project .peHonnel. had 

" i "^1*^;^^^^ at5|a|l, and another 21 p^t^erit^ad published, no more thap three 
iilifc*^* flies; .less , than\haTf of theSe RDD4E -persoflpp belonged'. t any professional 



>s 




Ik 



'•^- ^ 
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2; The interval between inception of work and ■i^serTt&tion at ^ \ ; i 
* a nati ojial. tneeti ng . i s generally 1 ong er in Abe 'sfeia l sciehcek'.' 
~ ^han in the physical sciences. Nea'fly three years elapse ' 
between inception of work and journal, -pr^sejltat ion; and 
. another -yfarvpr two may elapse before the"^.iioH^isMndeVed<l^^^ ./ 
and Vevjewdd. Consequentl^^our latest ; know! edge produerion.^' 
Indicators may be reflecFint>esearcH^'yiprk th^, on th^^aveV-- ; 
age, was comnefiCiBd four or five year&;^rev f^(-Usly. ' r > . 



3. .^iThe*' informal «»»etwork associated witli^^^prOTeeling and pr^^^ ^' 
■licatipn information exchange is poorly structured,.%.g^^^^ 
opjy 40 percent of -.authors publishing in s^en core educ|4 |- 
t,^&ftal-v research jotfrnals-'distributed fireprints arid|bnly-l^»^-^t 
percent had made oral, reports onrthe'vcontients oKtfeir" 
., nal 'articles. These prepubliqation exchange rateVi?iir -etf(|T^/ 
cation researchers are among thehowest of. all 
Xhat have been studied. ,5su^' "''i- D'^'-i* 




4. 



The formal -public^lion system in educatilbn i &'e)(ti0^c^i^\ --i!^- ; 
diffuse.. CIJE \ndexes -qver^OO periodical s./vStudtes'-fc-^^^^^^ v '-> ,, 
Carnot NelSpn" and others 'shSw that %re&der4«niy ^K|vi*|oSW..^^-t^ ■ 
read Iff to 20'j6iirnars to c%er one-B^liF the' aour^fe^^0^<^=£^^#^^ * 
, f or - rejsearcjf - rfeporifed at.'AER^ annual' m,eett>i'^gs. - JiH^^^ifi-r 
.literatorie ifi. education is .typified J>y an^^artkle 'W^ /■••V.^;, 
."ports the ffesults of a sfngl.e. sti^jfyy. don€f,..by 'arv'a(:e^+^^ 
.'never published, anyth-ing els'e • inV/the a^g^""«^^lthou'(d|lf 
i ? evidence for;-^uch tighter^eomiTifipijca^ettT among plrs^'stfellt 
active researchers ;in .the "saV. agefV most, of th^ediicatioTi 




- < '.5. 



.' I 'research literature is prodjuced p. TiT^iividtia}.scb:peir^Si'n'g-.afr 
most- completely independent; of clp|e: 4flf0rmal' vcdmiBDjriic^t^'a 
with othfer. investigators. ^J^:! '■ " ? > r-:-'' ^ 

Studies of iiiformatiwi use during the^ondyct of^^^h' edli^^^^^^ ' 
;^ ,t:ional research project (see immediately feelow) suggest- that 
V external sources. Qf Informatlor) ^are not often sought during 
^the planning stageV^ that most jnfoffnat ion seeking is 
confined to the: la.ter analysis ^nd report pVeparatioji stages. 

These studies, s^iggest- that the \great majority of but^ot all , 
educational' researchers operate in" poorly structured- communi-r 
cation environments that apparently do not strongly support 
oc erjcourage'effect|(j.ve knowledge u?flizat4on during project 
planning stages or effective^communica'tion of r;'es.ults on 
project completion. 



Nelson and Wickoff (1973) provide a detailed picture of information needs 

^ .'■■»■ 



6, 



and sources used as a' function of ^type of research^ctiVitie?. as reported by 
260 authors who had ffubl i shed , in' seven "core" educational resaarcn journals' 
-over a .26 month period. This study of infQrmation'use in' educational research * 
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fs- among the most domprehensrve to be untte^^ this area^ The stages of'-- • 

research-am^d-the-p~erce|b^ge-^^ 

neede<i and -sought information beyond their, own 'knowledge at that stage in their 
'research are displayed in Table A-T. I 



TABLE A-1 



.^USE OF INFORMATIOIVDURINGTHE CONDUCT OF'eDUCATIONAL RESEARCH PROJECT 



Stage of Research 

Preliminary Planning 
. Preparatjon af Proposal 
Conceijjtijal Planning 
Apparatus Design Planning 
^Study Design Planning 
Other Plar^nJng- 



\ 



^Calibration, Pretesi ting, etc. 

^ Prel iminary E)5perinjentation, 
' Field Trials, or Hockups 

Collect i(5n df Data 

^ . ■ ■•■ - -J r ■ " v 

Analysis of Results 
Interpretation of Rg^ults 
Preparation of Report v 



Proportional Use (%) 



V 

3.3 

1 .0 . 



2p;o Plarining 





18; 2 . Col lection 



24.V Analysis 
37.7 Reporting 



.;• » ■:if>. ■ ■ . 



Ar4 



; tfte potential value of the classification of infannat:^ion need by stagfe of 

■ ■ ■■'■i . ' ■ . ' '-i ' ' * . ' 

research is clearly evidenced in this table which indicates that only a' fifth 

■ . • ■ ■ ■ , , • ■ ' ■ - . . ^ 



^ of We information these ZSO^^iuthors' sought was required during research pl^n- 
ning stages, whereas over sixty percent, of the information was sought during 
anaiysis-or report preparatfion stages." The- Nelson afid Wikoff study also indi- 
cates that educational resear;f:hi^s enc9unter a wide variety of information needs. 



• See Table A-2. iTNote that percentages reported in. Table -A-Z exceed 100 because. 

the- same infonnation seeking activity may be classified as meeti ng , more than one 
class of information needs.) the Nelson and Wikoff study also provides several 
cross classifications (e.g., infonnation need as a function of stage of research; 
information source as a function of stage of research). 




TABLE Ar2 
.AUTHOR'S INFORMATION NEEDS 



^formation NeediS 

~'~ — 



Perception, or definition of. problem J 
Formulate scientific or technical solution 
♦Place w<*rk in proper context with similar wc»*k 
Relate woric to ongoing worjc-. 
Select design s tr at eg\^^Kd«ita ctil lection. 
Select data gathering'^t'echhf^i^^^ 
•Design equipment of^^^ apparatus' ^ 
Ch^os€ data anfj^sis technique 

■ ' ■ 

Enable intrepretation off data ^ 

Integrate findings ihto ciirjcifttt state of 
knowledge in, area " ' ^ ■ 

— •— — . — . ■<>■ . V ■■■ ' ' m 



* Rergnt. totals more thart lO^siiice tjie same'iBfoWiiajk^ 
assRiated with more, than one /leed. 



Percent * 
36.5 i\ 
28.1 
47.9 
. 43.8 ' 
29.2 — ' 
.., 2V ■ 

■ % 1 6';7 ■ "'■ 

34.4 
32.8 
38. S • 

search may be 



#1: 
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PRACTITIONER-ORIENT|g-STUDIES OF INFORMATION NEEDS AND USE 

" In general , the iriforjnw^l^^^^^ behavior 6f practitiioners atid of 

other types of educational' groups has not been studied as closely as that of L 
educational researcliers.. However a number of studies are available (Merse-l, 
1966;>iood an^ Hayes^i 1967;f R>ttenhouse/aqd He^d, 1968; White, 

••' ■ ^"-1^ ^- ■ -v-'' ^ ■■ / ^ ^ A • ■ 

1968; Kymer^^^69; ^^ ^ INFROSS, 1971; 

Si^^terr^^^^ 1976; Hood, Mick,. ^and 

Katter^^*^?^^ for many different pur- 

jjoses ■ arfMhptdyed' di 1^)6^,1^1/5^ ds^^' que^tiori^ and types of analyses , some 



l^MSrSr*{e.g.', teaq 



^^'^^agfffiat- 

jro^rt ;Staf f 

r >feren£ positions 
. /ferent^Q^^ 

seeing and 

o> r^tjj ' 
R&D^HI^asejl > 
Vunsitfi table 
und^^fo&d 

3./ QeAer^iy^^ 

■ / fbwnalionv- 
or gatTi&rt 
he f3t:t;,tha^?fcost 
formal tm^tii fig' in 





namely: 



instr^MCtJonal siip- 



i/iisuf^^ gbverna^ncifi^^ dif 
" "^"^"^ Tit.roVei. these dif-^ 

e|r inform'a- 
hn^ion 

qR^.in| 

r^djpctsion- 
n f ) nd ;^ 
intcx print 

?t'ai^r«iHp^ 
that fit ts^i 
fiy , Qr .not • presented 

r6 relatively ^all amourFts;^ : 
id: highly div^erse bo4y of in- 
aVe seriously, restricted time 
Cdmpeunding^this 'problgn is 
practTofiersIhave had relattyfely^^ittle 
ihformat'ibrr search and retrieval. Mure- 




■overi- the. or^ajiiza^ional , .social and ^cultur^l systems of 
.most educatXpnajS practfojiers^ prov'i^e relatively few rewards 





i>f opMttdrt ; ' hence mbt 



external source of 
fncf and use is typi- 





:6CTe>*iil4y,.^h accessibje spurces (oeople in . 

^dmjyfgam or files fn own p*ffc6, personal . 

V.lTpif^ry, jour^ newsletters, memos and correspondence) 
' ,are"the\BQ$t ^reiquent^ used sources* 'Contacts (face-to- 
face or by t€N|ephone). with people in' other organizations 
:- foiloww Ne*t; come, more- fprmal information s&Urces (library 

or resource center in' own organization'i ef^icfe^ department 
. or organization files). Conventions, profifessionalassocia- ^ 

tion meetings iarid workshops, seminars ana graduate courses 
5 are mucfi less'^fr'equently used.' Te)itbopks, reference booki, 
'^and (curriculum materials are frequently used by all practi-'^ 
tiorjers directly concerned with instruct;ion, but are far 
less frequently- used by other types of educational groups. 
Technical reports; libraries; resource centers, or informa- 
tion 'services that are. not cloise by, and abstracts, indexes 
and bibl io§ " ' 
user grbu 



5. 



Withiji this 
differen,t sour 
to the iiidivid 




used much* less frequent^ by most,- 




f 




pattern of relative frequency ;pf use *a^f 
here are sighif icant ,dif fererjces according 
:-j3Gsition or i:93.e. -^rjrtstructi^^^^ staff 
' tend to be more frequent users of Vlib^aries, t and 
" '.curriculum mat-erial sVand, relativfe to. o'tlier educational 

"group^,, less freQwent users of interpersonal /sources (face^ 
J, to^.facVdls^^ Administrators, 

by^contra^t^,^^^^^^^^^^ all interj^ersonal 

. sourpes ap^re^^^^^^ heavy -wre^ of ritemos, correspondence, 
-and own' owfee!^^rid^5gan.i?atio Governance groSpjfs - 

(10caV'and;;st^^i|Schoo] board m^bers, state' tegi si atorl'^ 
JJ.S. Con5ress^j^fi^^^^^ grieat 'similarity in soulrces* 

jTOt used ;fr<equenfly^(e.g. , abstf.acts,'''inde and bifelio- 
griaphies; cuijficulum riiateriils; personal; l ibrary; conven- 
tions and pr^bfessional: meetilws). * * - 

^ ■■ : ■ ^ ■ % 

6« Tulith a few exceptions, eduGationaJ pKactionerP^J'ith m^^ ^ 
Uy. different work activities, requiring different types of 
information and with markedlj^ different^ preferei^s for 

/ types of s'^urces, display many similarities in the reasons 
tliey, give for their preferences .'for the different^ sources 
they use. /Regardless of the type^ot^^sggrce preferred, most 
practitioners are liHftly to turn to this'^source because the 
source: 1) js likely to have, the wanted info*rmation, 2) is ^ 
near at hand or easi ly. :£iccessible,= 3) is responsive to the 
individual's particular'lpi^^ or question, 4) is easy, to 
Use, and 5) is usuallyyil^illM when needed. By ^contrast * 
among the least impt^tant characteristics of a preferred 
source, is that. ft;, is^object;^ve, impartial, nof ^'aseld; 
'^ Is free or inexpensive; or is complete or comprehensive.^ ^ 
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7* Among different edycational infonnat ion -user pasitioiis tlTepj^ 
* i are statistfcally significa^it differences in need for irtforfna- 
tion for different purposes, thus confirming a possibly^ob- 

lQus,,assiimptJi)n_that different-^^ of usens-wouTd^hav^- 

fferent p.urpojses for seeking information. How^r, des- 
'pite these significant (Jiff^erenpes, a strong gener^il pattern 
tends to characterize njost/userrgrou^ Overall, the' purpose 
which shows the greajie^t n^ for i>nf^ is keeping 

aware of developments and activities j*n education. The sec- 
ond most important, is need for iqiformatidn to .find specifiiQ 
answers to questions arising in relatton\b the individual's 
- own wonk. Identifying new sources of assistance for improve- 
•^ing one^s own work and developing alternative approaches to 
fsol.vipg pfioblems are also relatively high in need for infor- 
mation. By contrast, most practitioner us^ groups have 
only^^^oderate or small needwfor information in ord^r to. .pre- 
pare^^epprtsli^^articles/ or Ipeeches. ^ ^ :f 



8. 



"Aside from general infomjation about relative frequency of 
1; us^ oc^sers- ratings of importance of l:ln|^rmation for dif- 
ferent purposes, we"" have relatively li^^Thformatibn con- 
cerning actual use or; benefit. .The E(fa^^.pnvInfonnati^ 
r4arket-Study (Hood ?nd Blackwell, 1976^base^^^on;^ in- 
terviews wit l\ 137 key edupational informat,j§n uSfe^^^^^^^^^^^^ 
senting 18 different educational roles. a 
40 communities throughout the U.S.„ stigil 
viewed are heavily e/igaged in rtaiMjnding^i 
information and spend ^bstantiaT amoun 
ikresponding to such reqpiBsts. When ask 



ticularlfnajor task j 
in which they wer^| 
really needed .ortj/a) 
mary end use was 

)tT 



Ljty_completed 





ov«r 
inter- 



uing information the/-^ 
indii^ate'd that the firi 
^indings to. others; 

at i on i nte-^ - 
^pTSfcent applied the 
'dvtevar, over 90 perc&nt 
in^fdent" fnfol^ation on to 



^ anotfier 27 percent 
larger communic,atTbn 
information in some; 
said they passed this "critic^ 
• Gthers|^.pf those passing' it* 0%, "26 percent passed along 
, to othl||^ as is, 38 percent summarized it^ 30 percent jntgr 
^ ^preted or eval uated-it, and;^.,^||feij^^ .gave resiwnses. that 
• could not be classified.' '^'Mii^ir;!:^^''- " - ' ^ 

^ser gro#ps differ both in the^ff^^ of persons that come 
^0 t|em for information and j in ^ho^hey tnarisJ^Inn informa^ 
tion that they provide 'to others* leachers es;t;imate that 
less than a hundred pers^ai^per^^ come to them 
information, schoor prin^pals^aveif*age two hundft^eci 
a y6|ir, state and local educatiibn agency staff 
average closer/to eight /Or^nitie hundred^ persons 
while stdtfr anU locatl schbpl board memfers -aver 
four and five^r^F^d persons a year. Scho(/l pr 
(and U.S.* Congreisfoh^aV aides) interpret oryevaluate nearly 
all the "critical incident'*. ir\f^niiat ion th^ provided to* 




others.** Other grQiips which tend to interpret or;,.at' least 
summarize much of the information they provide to others in- 
duce: college of education faculty, state agency staff, 
iiif ormatioiuceater^^t af f ^ . s ug ^y tsors^of-iast ruct-i^n-and- 



school district staff. Among 'tfie qrouPMwith greater prop- 

:rms 



ensity to pass infoniiation i;iB^dng ;t "as is" are special • 

interest group representatives, fntennediate unit staff, 
state legislators, and state agency dissemination ^nd infx)r- 
mation staff; Perhaps the major Sfgntficance of these data 
are that the information requester ^may not^e, and mo$t 
probably is not, the ultimate end user, _ 

Regarding ulitmate en^'d use, the Pilot State Demqstration ' 
.Program (Sieber, Louis, and Metzger, 1972)' at least provides 
a rough ind^x of util ization based on 6^cl lent requests 
in the thre0 PSDP states, Approximately*50 percent could 
'identify no specific use. or few benefits derived from the - 
informatipn that was delivered. The remaining 40 percent * 
identified some use; but only.^Ven percent could tdentify^- 
> a specif fc practice or prograjl that^ was implemented, 14 per- 
ent identified other generar uses (e.g., planning or proposal 
writing) and also chedjied a higher than med-ian number of ad- > 
ditional ways in wf^Tcl^the'^.information or assistance helped ' 
thenj; l&nong the most fr^qlient benefit s/feit eel by PSDP clients 
< are the' following:^ \* ' ' ^ . v ^ 

'^ ^(57%) I learnfed. something new ^'■ •^ , " ^^"^ 
(5l%) 'It gave- me new resburces toi^hel ping, othep^^staf"f members 
(38%) It provided [one of four^^^?ifc:ic pcto tfhefits ; 
f34%j It made Bi^ job easier .^^S^' ^i-' ' ' -'K- 
(30%) It helpe^^v^ith d1l|admini ' 
m%) ft improved; my sian^^: ■ 

(26%) It helped in preparing a ^j^bcfe, fepprt * or: article €J 
(21%) It helped me to have ,greater\ self cor^fidfence 
(19%) It helped me. develop instructional packages. 

Most practitionei# display^anv-arinual cycl^ o 
use c^iresppndirtg to the spl^ccpl:; calendar. Mrf_.. 
rises%narp1y in September , '5*rops off' slowly t^L, 
rises again in January, and is at average lev<|ts|H 
Needs, in June, July, and- August are about, haVfi '^^ 
remainder of the year. Other calendar cycles ejf^t^^^^ 
legislative and fiscal activities, but thes^^iyclas 
well documented. mm, 

* ■,■'■'■»-_ . ■ ■ ■ ■ y. 
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